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Message from the Director 



Many teachers worked with 
Alberta Education during the 
1996-97 school year, assisting 
with various aspects of the 
Diploma Examinations 
Program. Teachers helped with 
the development of exam 
questions, as well as field 
testing, administration, and the 
marking of the diploma exams. 
Superintendents, high school 
principals, and others in our 
school systems also helped 
make the examinations program 
work. We appreciate this 
assistance and the commitment 
of school districts to a high 
quality examinations program. 

This annual report combines the 
November, January, April, 

June, and August provincial 



results in diploma exam courses. 
The graphs, tables, and text 
describe student performance for 
the entire school year. This 
report is designed to assist 
school personnel in identifying 
patterns of students’ 
achievement in the province and 
monitoring the effectiveness of 
their programs in supporting 
student learning. 

The Annual Report is also 
available on Alberta Education’s 
Home Page (http://ednet.edc. 
gov.ab.ca). This supports our 
goal of providing information to 
Albertans about student 
achievement in this province. I 
hope that many Albertans will 
look at this report and find it of 
interest and value. 





Brackenbury, Director 



Section 1 

Grade 12 Diploma Examinations Program 



Diploma examinations are 
administered in November, January, 
April, June, and August of each school 
year. 

The Grade 12 Diploma Examinations 
Program, established in 1984, has three 
main purposes: 

• to certify the level of individual 
student achievement in selected 
Grade 12 courses 

• to ensure that province-wide 
standards of achievement are 
maintained 

• to report individual and group results 



The examination development process, 
described in Appendix A, ensures that 
this form of assessment provides valid 
and reliable results. Eleven Grade 12 
courses have diploma examinations, and 
seven of these* are available in French 
translation: 

• English 30 

• English 33 

• Social Studies 30* 

• Social Studies 33* 

• Fran$ais 30 

• Mathematics 30* 

• Mathematics 33* 

• Biology 30* 

• Chemistry 30* 

• Physics 30* 

• Science 30 



This Diploma Examinations Program 
Annual Report provides province- 
wide results for the entire school year, 
that is, for the November, January, 
April, June, and August examinations 
combined. Additionally, the annual 
report provides summaries of results 
by gender and for population 
subgroups. 

Occasional research findings on issues 
of topical interest related to the 
program are also featured. In the 
1996-97 report, an achievement-over- 
time study is presented. 

The 1996-97 Annual Diploma Report 
incorporates some changes to data in 
previous Annual Diploma Reports. 



Certification 

A student’s final mark in a diploma 
examination course is a fifty-fifty 
“blend” of the examination mark and 
the school-awarded mark (except for 
students with mature status; see 
Section 4). For example, a diploma 
examination mark of 57% combined 
with a school-awarded mark of 45% 
would produce a final course mark of 
51%, a “pass” in the course. This 
student would earn high school 
graduation credits for the course. The 
“blending” of the two marks to produce 
a final course mark recognizes the fact 
that the diploma examination assesses 
only those learning outcomes, listed in 
the Program of Studies, that can be 
effectively measured in a limited time 
using paper-and-pencil tests. The school 
can best assess students’ achievement in 
the laboratory, in research, in oral 
communication, and in cooperative 
learning. 



students are expected to do; that is, the 
bulletins outline the assessment 
standards for each diploma examination 
course. Students who achieve the 
acceptable standard of performance 
receive a final course mark of 50% or 
higher. Students who achieve the 
standard of excellence receive a final 
course mark of 80% or higher. 

Reporting 

The results achieved by students in the 
Diploma Examinations Program are 
aggregated at the school, jurisdiction, 
and provincial levels and are presented 
in this and the three reports described 
below. The purpose of the Diploma 
Examinations Program is to help school 
administrators, teachers, trustees, and 
Alberta Education evaluate the 
effectiveness of educational programs. 
Guidelines for interpreting and using 
these reports are given in Appendix B. 



other educational institutions 
approximately three weeks after the 
January and June examinations are 
written. The report is also available to 
the public on request. The reports 
issued in 1997 are reproduced in 
Appendix C. 

School and Jurisdiction Reports for 
each diploma examination course are 
made available electronically to 
superintendents and principals soon 
after the January and June 
administrations. These reports provide 
results at the question and sub-test level 
for each school and jurisdiction. This 
information is particularly useful in 
assessing the strengths and weaknesses 
of local programs. These reports are 
available to the public through the 
superintendent or principal, according 
to local board policy. Summary reports 
are also available on CD-ROM from 
the Learning Resources Distributing 
Centre. 



Standards 

The Program of Studies for each 
diploma examination course outlines 
what students are expected to know and 
to be able to do in order to pass the 
course. Information bulletins published 
at the beginning of the school year 
^“ovide details about “how well” 




These reports should not be used as 
the basis for evaluating teacher 
performance or for comparing 
performance between schools or 
jurisdictions. 

Percentage Distribution of Marks in 
Diploma Examination Courses is a 
three-page report distributed to 
educators in schools, jurisdictions, and 

12 



Examiners 9 Reports for each course, 
which are distributed after the January 
and June writings, are intended 
primarily for teachers. Provincial 
results are provided in relation to 
course standards as reflected in the 
examination blueprints and information 
bulletins. The January and June 1997 
Examiners' Reports are available 
online at http://ednet.edc.gov.ab.ca/ 
studenteval/diplomaexams . 



Section 2 

Summary of Results 






This section provides the overall 
results and describes certain broad 
characteristics of the students who 
wrote the diploma examinations. 

The following questions will be 
answered: 

• What percentage of students 
achieved the acceptable standard or 
the standard of excellence according 
to criteria set by Alberta Education? 



• How many students wrote each 
diploma examination and how do 
these numbers compare with the 
previous two years? 

• What was the average number of 
different diploma examinations written 
by each student in each course during 
the 1996-97 school year? 



• What was the distribution of A, B, C, 
and F grades for each diploma 
examination course and how does 
this distribution compare with 
distributions of previous years? 

• For each diploma examination 
course, what is the relationship 
between examination marks and 
school -awarded marks? 



What percentage of students 
achieved the acceptable standard or 
the standard of excellence according 
to criteria set by Alberta 
Education? 

Figure 2- 1 shows the percentage of 
students achieving the acceptable 
standard and the standard of 
excellence based on the final course 
mark. The “final course mark” is the 
average of the school-awarded mark 
and the diploma examination mark or 
as otherwise provided by Alberta 
Education policy. 

During the 1 996-97 school year, final 
course marks showed that in all 
courses, except Mathematics 30 and 
Mathematics 33, more than 90% of 
students achieved the acceptable 
standard. A high percentage of 
students achieved the standard of 
excellence in the sciences (i.e., 
Biology, Chemistry, and Physics) and 
Mathematics 30. 

In Alberta, courses are selected by 
students according to their own needs, 
aspirations, and expectations. This 
may account for much of the 
differential achievement among 
courses. For this reason, local targets 
for the percentage of students 
expected to achieve the acceptable 
standard or the standard of excellence 
are best set in the context of local 
policies and conditions. 




Figure 2-1 



Percentage of Students Achieving Standards (Final Course Mark) 
1996-97 School Year 
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How many students wrote each 
diploma examination and how do 
these numbers compare with the 
previous two years? 

As shown in Figure 2-2, the number of 
students writing diploma examinations 
increased in 1996-97 for several 
courses, compared with the previous 
year. 



The enrollment in 1996-97 for Social 
Studies 33, English 30, English 33, 
and Mathematics 33 increased 
considerably from the previous year. 

Note: All students who wrote more 
than one diploma examination in a 
course during a single year are counted 
only once. Students who wrote 
examinations in the same course in 
different years are counted once in 



each year they wrote. Students from 
the Northwest Territories are not 
included in these counts. 

Diploma examinations were 
administered for the first time in the 
1995-96 school year for Social 
Studies 33, Mathematics 33, and 
Science 30. Consequently, only the 
1995-96 and 1996-97 results are 
reported for these three subjects. 



Figure 2-2 



Number of Students with School Awarded Marks Writing Diploma Examinations 

in Each Course 

1994-95, 1995-96, and 1996-97 School Years 
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What was the average number of 
different diploma examinations 
written by each student in each 
course during the 1996-97 school 
year? 

As shown in Figure 2-3, the average 
number of different diploma 
examinations written by students 
ranged from a low of 2.50 for students 
writing the English 33 examination to 
a high of 5.31 for students writing the 
Fran9ais 30 examination. 

What was the distribution of A, B, 
C, and F grades for each diploma 
examination course and how does 



this distribution compare with 
distributions of previous years? 

The distribution of A, B, C, and F 
grades for each course is shown in 
Figures 2-4 to 2-25. 

There are two graphs for each course. 
The first shows the distribution for 
final course marks over the last three 
years. 

The distributions remained relatively 
unchanged over time for all courses. 

The second of the two graphs shows 
the 1996-97 school year distribution of 



A, B, C, and F for the school-awarded 
mark, the diploma examination mark, 
and the final course mark. 

The number of Fs awarded to 
students for a final course mark is often 
lower than the number of Fs awarded 
for either the school-awarded mark or 
the diploma examination mark. One 
reason for this is that no final marks of 
48% or 49% are awarded. If the 
average of the school-awarded mark 
and the diploma examination mark is 
48% or 49%, the student is 
automatically given 50% as a final 
mark. 



Figure 2-3 

Average Number of Different Diploma Examinations Written 
by Students in Each Course 
1996-97 School Year 
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diploma examinations written 
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Figure 2-4 



Figure 2-5 



English 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-6 

English 33 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-7 

English 33 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-8 
Social Studies 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-9 
Social Studies 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-10 

Social Studies 33 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-11 

Social Studies 33 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-12 

Fran^ais 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-13 
Fran^ais 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-14 

Mathematics 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-15 

Mathematics 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-16 

Mathematics 33 
Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 



Figure 2-1 7 

Mathematics 33 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-18 



Figure 2-19 



Biology 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 



Biology 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-20 



Figure 2-21 



Chemistry 30 
Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 



Chemistry 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-22 



Figure 2-23 



Physics 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 



Physics 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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Figure 2-24 
Science 30 

Distribution of A, B, C, and F 
for Final Course Mark 
Three School Years 
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Figure 2-25 
Science 30 

Distribution of A, B, C, and F for School, 
Examination, and Final Course Marks 
1996-97 School Year 
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For each diploma examination 
course, what is the correlation 
between examination marks and 
school-awarded marks? 

Table 2-1 presents the correlation 
coefficient between diploma 
examination marks and school- 
awarded marks for each diploma 
examination course. The maximum 
correlation coefficient is 1.0 
representing a perfect relationship. 



The two marks represent separate 
assessments of achievement, each 
based on an overlapping yet different 
set of curricular objectives. To a large 
degree, these objectives are similar; 
however, there is a necessary degree 
of difference. 

The diploma examinations are limited 
to measuring achievement of 
objectives that can be effectively 
assessed by paper-and-pencil tests. 
School assessments also measure 
achievement of additional objectives 

Table 2-1 



such as laboratory skills in the 
sciences, or speaking and listening 
skills in English. Therefore, these 
correlations are expected to be 
positive and relatively high. 

Other factors that contribute to the 
less-than-perfect correlations include 
variations among teachers’ assessment 
practices, the longer time span of 
school-based assessment, the effect of 
failure to complete assignments, and 
the individual student’ s approach to 
the different types of assessment. 



Correlation of Diploma Examination Marks and 
School-Awarded Marks by Course 
1996-97 School Year 



Course 


Number of Students 


Correlation 

Coefficient 


English 30 


22 107 


0.625 


English 33 


12 679 


0.402 


Social Studies 30 


19 209 


0.725 


Social Studies 33 


13 095 


0.518 


Fran9ais 30 


85 


0.704 


Mathematics 30 


18 246 


0.790 


Mathematics 33 


11 333 


0.692 


Biology 30 


17 033 


0.807 


Chemistry 30 


14 985 


0.792 


Physics 30 


8 391 


0.746 


Science 30 


1 077 


0.568 




8 



A 



Section 3 

Results by Gender 



This section of the report provides 
separate results for males and females. 
The following questions will be 
answered; 

• What proportion of males and 
females write diploma examinations? 

• Is the percentage of males and 
females who achieve the standards 
the same in each course? 

• Are males and females awarded 
similar school marks? Is the pattern 
the same for diploma examination 
marks? 



What proportion of males and 
females write diploma 
examinations? 

Of all students registered in Grade 12 
on September 30, 1996, 51% were 
male. Figure 3-1 shows that in the 
1996-97 school year, fewer males 
than females wrote diploma 
examinations in all courses except 
English 33, Social Studies 33, Physics 
30, and Science 30. The reasons for 
this underrepresentation of males 
among students writing most diploma 
examinations cannot be determined 



from the available data. Schools and 
jurisdictions that wish to explore this 
relationship further could look at; 

• the percentage of males and females 
seeking a high school diploma 

• the percentage of males and females 
returning to school for a fourth year 
of high school and the courses in 
which they choose to enroll 

• the percentage of males and females 
who register in a course but drop the 
course before writing a diploma 
examination 



Figure 3-1 

Ratio of Males to Females Writing Diploma Examinations 
1996-97 School Year 



English 30 
English 33 
Social Studies 30 
Social Studies 33 
Fran5ais 30 
Mathematics 30 
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— The vertical broken line shows the 
percentage of all students registered 
in Grade 12 on September 30, 1996, 
whether male (5 1 %) or female (49%) 
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Is the percentage of males and 
females who achieve the standards 
the same in each course? 

Figure 3-2 shows that a higher 
percentage of males than females 
achieved the standard of excellence in 
their final course marks for Social 
Studies 30, Social Studies 33, 



Mathematics 30, Chemistry 30, and 
Physics 30. 

A higher percentage of females than 
males achieved the standard of 
excellence in their final course marks 
in English 30, English 33, Fran^ais 30, 
Mathematics 33, Biology 30, and 
Science 30. 



The percentage of females who 
achieved the acceptable standard 
exceeded the percentage of males in all 
courses except for Social Studies 30, 
Social Studies 33, Mathematics 30, 
and Chemistry 30. 

Table 3-1 shows the actual number of 
male and female students who 
achieved standards in each course. 



Figure 3-2 

Percentage of Students Achieving Standards, 
by Gender (Final Course Mark) 
1996-97 School Year 
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Table 3-1 

Number of Students Achieving Standards, by Gender (Final Course Mark) 
1996-97 School Year 



Course 


Students Achieving 
the Acceptable Standard 


Students Achieving 
the Standard of Excellence 




Male 


Female 


Total 


Male 


Female 


Total 


English 30 


9 464 


12 231 


21 695 


1 156 


2 114 


3 270 


English 33 


6 700 


5 409 


12 109 


225 


373 


598 


Social Studies 30 


8 709 


9 602 


18311 


1 772 


1 577 


3 349 


Social Studies 33 


6 180 


5 765 


11 945 


302 


250 


552 


Fran5ais 30 


31 


53 


84 


5 


9 


14 


Mathematics 30 


8017 


8 134 


16 151 


2 026 


1 808 


3 834 


Mathematics 33 


4 869 


5 093 


9 962 


682 


889 


1 571 


Biology 30 


6 374 


9313 


15 687 


1 625 


2 530 


4 155 


Chemistry 30 


6 498 


7 097 


13 595 


1 595 


1 452 


3 047 


Physics 30 


4 800 


2 984 


7 784 


1 314 


771 


2 085 


Science 30 


497 


474 


971 


29 


43 


72 




Are males and females awarded 
similar school marks? Is the 
pattern the same for diploma 
examination marks? 

Table 3-2 shows the results of a 
comparison between the school- 
awarded marks and diploma 
examination marks for males and 
females. When averages in school- 
awarded marks are compared, 
females are seen to achieve higher 
averages than males in all courses 
except Social Studies 30. In all 
subjects, the percentage of females 



receiving an F was smaller than the 
percentage of males. A greater 
percentage of females than males 
achieved an A in all subjects except 
Chemistry 30. 

With the diploma examination marks, 
females achieved higher averages than 
males in English 30, English 33, Fran$ais 
30, Mathematics 33, and Biology 30. 
Males achieved higher diploma 
examination marks in the other courses. 

For the final course marks, females 
achieved higher averages than males in 



English 30, English 33, Fran^ais 30, 
Mathematics 33, Biology 30, Physics 
30, and Science 30. The percentage of 
females receiving an F was greater 
than the percentage of males in Social 
Studies 30, Social Studies 33, 
Mathematics 30, and Chemistry 30. 
The percentage of females achieving 
an A for the final course mark was 
greater than the percentage of males in 
English 30, English 33, Frangais 30, 
Mathematics 33, Biology 30, and 
Science 30. 



Table 3-2 

Provincial Percentage Distribution of A, B, C, and F, Average, and Standard Deviation* of Scores 

1996-97 School Year 



Course 


School -Awarded Mark 
Total Male Female 


Diploma Exam Mark 
Total Male Female 


Final Course Mark 
Total Male Female 


English 30 

A (80-100%) 


20.7 


15.4 


25.0 


13.9 


12.7 


14.9 


14.6 


11.8 


16.9 


B (65-79%) 


43.6 


42.1 


44.9 


35.6 


34.7 


36.3 


42.3 


40.4 


43.9 


C (50-64%) 


30.3 


35.3 


26.3 


38.5 


39.8 


37.4 


39.4 


43.2 


36.4 


F (0-49%) 


5.4 


7.3 


3.8 


12.0 


12.9 


11.3 


3.6 


4.7 


2.8 . 


Average (%) 


68.4 


66.2 


70.1 


64.7 


64.0 


65.2 


67.0 


65.6 


68.0 


Standard Deviation (%) 


,12.4 


12.5 


12.1 


13.0 


13.1 


13.0 


11.4 


11.3 


11.3 


English 33 

A (80-100%) 


6.5 


4.1 


9.7 


7.1 


6.0 


8.6 


4.3 


3.0 


6.1 


B (65-79%) 


35.4 


30.6 


41.8 


38.7 


37.4 


40.4 


38.4 


33.9 


44.2 


C (50-64%) 


45.0 


48.8 


40.0 


; 40.4 


41.8 


38.6 


50.5 


55.1 


44.5 


F (0-49%) 


•13.1 


16.6 


8.5 


: 13.8 


14.8 


12.4 


6.8 


8.0 


5.2 


Average (%) 


H61.3 


59.2 


64.0 


62.7 


62.0 


63.6 


62.6 


61.2 


64.4 


Standard Deviation (%) 


:;ii2.i 


11.9 


11.7 


11.8 


11.6 


11.9 


; 10 :f 


9.8 


10.1 


Social Studies 30 

A (80-100%) 


’*22:7 


22.6 


22.7 


15.6 i 


18.9 


12.7 


i 17.4? 


19.6 


15.5 


B (65-79%) 


^4 1:7 


42.3 


41.2 


1 33.7 4 


37.3 


30.5 


38.7 


40.8 


36.7 


C (50-64%) 


01.5 


30.8 


32.2 


:• 34:4 j 


31.8 


36.7 


( 38.9 


35.4 


42.0 


F (0-49%) 


S 4 - 1 


4.4 


3.9 


r i6*3 j 


12.0 


20.1 


5.0 


4.2 


5.7 


Average (%) 


Ii69.0 


69.1 


69.0 


b 64.1.1 


66.5 


62.1 


r 66.9 


68.1 


65.8 


Standard Deviation (%) 


J 12 & 


12.2 


12.1 


t. 14.31 


13.9 


14.3 


; 12# 


12.1 


12.3 


Social Studies 33 

A (80-100%) 


1" '5.6 


5.2 


6.0 


! 6.8 


8.2 


5.4 


1 ,'i 

l 

1- 4T 


4.4 


3.8 


B (65-79%) 


03:4 


31.4 


35.4 


34.9 U 


40.1 


29.5 


i 34 9 


36.8 


32.9 


C (50-64%) 


48.6 


49.4 


47.7 


; 39.1 1 


36.5 


41.8 


: 51.6 


50.5 


52.7 


F (0-49%) 


iA2A 


13.9 


10.9 


! 19.2 = 


15.2 


23.4 


; 19.4 


8.3 


10.5 


Average (%) 


161.0 : 


60.3 


61.7 


: 61. 0 i| 


62.8 


59.2 


61:4; 


62.0 


60.8 


Standard Deviation (%) 


El 1:5 


11.6 


11.3 


x ■ .... 

1 12.9 1 


12.8 


12.9 


| 10.6 


10.6 


10.6 



♦Standard deviation is an indication of the amount of variation in a distribution. About 68% of the students’ marks will fall within plus or 
minus one “standard deviation” of the average mark. On the English 30 Diploma Examination, for example, 68% of students who wrote 
the examination scored between 5 1.7 and 77.7%. 

♦♦Because very few students wrote the Franfais 30 examinations, results must be interpreted with caution. 
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Table 3-2 (continued) 





School -Awarded Mark 


Diploma Exam 


Mark 


Final Course 


Mark 


Course 


Total 


Male 


Female 


Total 


Male 


Female 


Total 


Male 


Female 


Fran^ais 30** 




















A (80-100%) 


20.0 


15.2 


23.1 


15.3 


18.2 


13.5 


16.5 


15.2 


17.3 


B (65-79%) 


50.6 


45.5 


53.8 


42.4 


42.4 


42.3 


47.1 


42.4 


50.0 


C (50-64%) 


24.7 


30.3 


21.2 


37.6 


33.3 


40.4 


34.1 


36.4 


32.7 


F (0-49%) 


4.7 


9.1 


1.9 


4.7 


6.1 


3.8 


2.4 


6.1 


0.0 


Average (%) 


69.9 


66.4 


72.1 


67.0 


66.0 


67.7 


68.7 


66.4 


70.1 


Standard Deviation (%) 


10.9 


11.7 


9.9 


10.9 


11.0 


10.9 


10.1 


10.3 


9.9 


Mathematics 30 




















A (80-100%) 


26.3 


26.2 


26.5 


19.2 


21.3 


17.1 


21.0 


22.5 


19.6 


B (65-79%) 


35.7 


34.5 


36.8 


27.3 


28.3 


26.3 


32.3 


32.0 


32.7 


C (50-64%) 


30.2 


31.1 


29.3 


28.7 


27.4 


29.9 


34.8 


34.1 


35.6 


F (0-49%) 


7.7 


8.2 


7.3 


24.9 


23.0 


26.7 


11.8 


11.4 


12.2 


Average (%) 


68.8 


68.6 


69.1 


62.3 


63.4 


61.1 


65.9 


66.3 


65.4 


Standard Deviation (%) 


14.2 


14.5 


14.0 


17.9 


18.1 


17.7 


15.2 


15.4 


15.0 


Mathematics 33 




















A (80-100%) 


13.5 


10.6 


16.4 


17.7 


17.1 


18.2 


13.7 


11.9 


15.3 


B (65-79%) 


31.9 


29.9 


33.9 


: 31.6 


31.1 


32.1 


34.7 


33.2 


36.2 


C (50-64%) 


38.8 


40.8 


36.9 


31.9 


32.5 


31.4 


38.7 


40.5 


36.9 


F (0-49%) 


15.8 


18.7 


12.9 


18.8 


19.3 


18.3 


13.0 


14.4 


11.6 


Average (%) 


62.5 


60.8 


64.2 


63.7 


63.3 


64.1 


63.7 


62.7 


64.6 


Standard Deviation (%) 


14.2 


14.2 


14.0 


15.7 


15.8 


15.7 


13.9 


13.9 


13.7 


Biology 30 




















A (80-100%) 


26.1 


23.6 


27.9 


24.6 


24.5 


24.6 


24.3 


23.2 


25.0 


B (65-79%) 


38.0 


36.1 


39.3 


29.2 


28.8 


29.5 


34.4 


33.1 


35.3 


C (50-64%) 


29.3 


31.9 


27.5 


28.0 


27.9 


28.1 


33.0 


34.8 


31.8 


F (0-49%) 


6.5 


8.4 


5.2 


18.2 


18.7 


17.8 


j 8.3 


8.9 


7.8 


Average (%) 


*' 69.2 


67.9 


70.2 


66.0 


65.9 


66.1 


68.0 


67.3 


68.4 


Standard Deviation (%) 


13.4 


13.8 


13.0 


16.8 


16.9 


16.8 


14.3 


14.5 


14.2 


Chemistry 30 


• 






• •••' 






^ *■’ 






A (80-100%) 


26.9 


27.3 


26.6 


C 17:7 


20.2 


15.5 


203 


22.3 


18.5 


B (65-79%) 


37.1 


35.2 


38.8 


| :30.3 


30.9 


29.8 


35.5 


34.4 


36.5 


C (50-64%) 


h 28.7 


29.6 


27.9 


? 31.2 


29.6 


32.6 


34.7 


33.9 


35.4 


F (0-49%) 


7.3 j 


8.0 


6.7 


j v20.7 


19.3 


22.0 


[$''9:5 . 


9.5 


9.6 


Average (%) 


69.2! 


68.9 


69.4 


; 63.3 


64.4 


62.3 


66.6 


67.0 


66.1 


Standard Deviation (%) 


13.9 


14.4 


13.4 


i 16.2 


16.5 


15.8 


yi4.2 


14.6 


13.8 


Physics 30 


r- S '- d 












rr ^ 






A (80-100%) 


32.2 ; 


30.8 


34.6 


fe‘22.9- 


24.0 


21.0 




25.2 


24.2 


B (65-79%) 


38.61 


37.8 


39.9 


*,28.2 


28.2 


28.2 


i 37; 1 


35.8 


39.1 


C (50-64%) 


24.21 


25.4 


22.2 


29.4 


28.9 


30.3 


: 30.5 


30.8 


30.2 


F (0-49%) 


; 5.0 

, • i 


6.0 


3.3 


Hi 9.5" 


19.0 


20.4 


7:6 


8.3 


6.5 


Average (%) 


71.7 


70.9 


72.9 


k \ 

E 64.8 


65.2 


64.2 


68.6 


68.4 


68.8 


Standard Deviation (%) 


: 13.5 • 


13.9 


12.6 


j 17.0 


17.3 


16.5 


L14.2 


14.6 


13.6 



(continued) 



♦Standard deviation is an indication of the amount of variation in a distribution. About 68% of the students’ marks will fall within plus or 
minus one “standard deviation” of the average mark. On the English 30 Diploma Examination, for example, 68% of students who wrote 
the examination scored between 51.7 and 77.7%. 

♦♦Because very few students wrote the Frangais 30 examinations, results must be interpreted with caution. 
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Table 3-2 ( continued ) 



Course 


School- Awarded Mark 
Total Male Female 


Diploma Exam Mark 
Total Male Female 


Final Course Mark 
Total Male Female 


Science 30 




















A (80-100%) 


7.1 


5.0 


9.3 


10.0 


9.8 


10.3 


6.7 


5.2 


8.3 


B (65-79%) 


32.2 


29.6 


35.1 


32.3 


33.7 


30.8 


35.5 


36.5 


34.3 


C (50-64%) 


47.4 


49.6 


45.2 


39.0 


38.3 


39.7 


48.0 


46.9 


49.2 


F (0-49%) 


13.3 


15.9 


10.5 


18.7 


18.2 


19.2 


9.8 


11.4 


8.1 


Average (%) 


61.5 


60.1 


63.0 


61.9 


62.5 


61.4 


62.1 


61.8 


62.5 


Standard Deviation (%) 


11.8 


11.7 


11.7 


13.7 


13.3 


14.1 


11.4 


11.1 


11.6 



♦Standard deviation is an indication of the amount of variation in a distribution. About 68% of the students’ marks will fall 
within plus or minus one “standard deviation” of the average mark. On the English 30 Diploma Examination, for example, 
68% of students who wrote the examination scored between 51.7 and 77.7%. 

♦♦Because very few students wrote the Franfais 30 examinations, results must be interpreted with caution. 



Summary 



There are gender differences in the 
marks obtained for the diploma 
examination courses. For school- 
awarded marks, the achievement of 
females is higher than males in ten of 
eleven courses. Meanwhile, for 
diploma examination marks, females 
have higher achievement in five 
courses and males have higher 
achievement in six courses. Overall, 
for the final course mark, females 
have higher achievement in seven of 
the eleven courses. For the six math/ 
science courses, females have higher 
achievement in four of them. It 



should be noted that a larger 
proportion of females than males are 
writing diploma examinations. 

Since individual jurisdiction results 
will show patterns that differ from the 
province-wide results, school boards 
are encouraged to explore gender 
differences in their own jurisdictions. 

The data presented in this section show 
gender differences to a greater or 
lesser degree in all diploma 
examination courses. Schools should 
consider these results carefully within 
their own contexts. 



We welcome any comments regarding 
observations or thoughts you have on 
gender differences in achievement. If 
you would like to share your thoughts 
with us, please contact Elana Scraba, 
Assistant Director, Humanities 
Diploma Examinations Program, at 
403-427-0010, toll-free at 310-0000, 
or write to her at Student Evaluation 
Branch, Alberta Education, 11160 
Jasper Avenue, Edmonton, Alberta 
T5K 0L2. 
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Section 4 

Results for Population Subgroups 

L_ 



The majority of students who wrote a 
1996-97 diploma examination took 
the course in school as regular 
students; the second largest group 
were mature students* with current 
school-awarded marks. Results for 
students with both school-awarded 
marks and diploma examination marks 
are reported in Sections 2 and 3 of this 
report. 

This section reports the results for all 
students, including those with no 
school-awarded marks. Subgroup 
definitions and results are reported. 



This section will answer these 

questions: 

• Does the percentage of mature 
students writing diploma 
examinations vary across courses? 

• How does the performance of mature 
students with current school-awarded 
marks compare with the performance 
of regular students with current 
school-awarded marks? 

• How does the performance of 
students with school marks brought 



forward compare with the results 
of students with current school- 
awarded marks? 

• How does the performance of mature 
students challenging the examination 
compare with the performance of 
other mature student subgroups? 

• For subgroups with current school- 
awarded marks and diploma 
examination marks, how does the 
diploma examination mark average 
compare with the school-awarded 
mark average? 



Subgroup Definitions 

Subgroups are defined by a 
combination of mature student status 
and school-awarded mark status. 
Students in all subgroups have a 
current diploma examination mark. 
The subgroups are: 

• Regular School Students with a 
current school-awarded mark. This 
group is comprised of regular 
students and mature students. 

Regular Students are students 
without mature status who have a 
current school -awarded mark. 

Mature Students are students with 
mature status who have a current 
school -awarded mark. 

• Regular Students, School Mark 
Brought Forward Regular students 
who do not have a current school- 
awarded mark but who have an 
earlier school-awarded mark. 

• Mature Students, School Mark 
Brought Forward Mature students 
who do not have a current school- 
awarded mark but who have an 
earlier school- awarded mark. 



• Mature Students, Challenging 
Examination Students with mature 
status who have no school-awarded 
mark. 

• Regular Students, No School Mark 

Regular students who have no 
school-awarded mark. 

Notes: 

1. Mature students “challenging” a 
diploma examination do not take 
the course but do receive course 
credit if they pass the 
examination; regular students 
with no school-awarded mark 
receive no course credit. 

2. When a mature student earns a 
diploma examination mark that is 
higher than that student’ s school- 
awarded mark, the diploma 
examination mark becomes the 
final course mark; otherwise, the 
normal blending is applied to 
calculate the final course mark. 



Excluded Groups 

Not included in any of the subgroups 
are students who were exempted from 
all or part of the examination, or who 



wrote a substantially different form of 
the examination because of special 
considerations. Students in English 30 
or English 33 who, by special 
permission, wrote the two parts of the 
examination in two different 
examination sittings (e.g., January and 
June) are also excluded. Very few 
students fall into these categories. 

Results for Fran£ais 30 are not 
included because of the small number 
of students writing the examination. 

Results 

Three tables are provided for each 
diploma examination course. In the 
first table, the number and percentage 
of regular and mature students writing 
are given. The second table gives the 
number of students in each subgroup, 
their average diploma examination 
mark, and standard deviations of 
diploma examination marks for all 
subgroups. The third table provides 
data for subgroups with school- 
awarded marks. It includes the number 
of students in each subgroup, their 
average school-awarded mark, and the 
standard deviation of school-awarded 
marks for these subgroups. 



* A student with mature status is one who, as of September 1 of the current school year, is 20 years of age or older or is 19 years of age and 
has been out of school for eight consecutive months since reaching the age of 18 or is the holder of a previously awarded Alberta high 
school diploma or equivalent (see the Guide to Education , Senior High School Handbook, 1995, pages C8-l,2). 
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English 30: 1996-97 School Year 



Achievement in English 30 by 
subgroups is compared in Tables 4-1 to 
4-3. About one in seven English 30 
students who wrote the 1996-97 
diploma examinations had mature status. 

Of students with current school-awarded 
marks, regular students achieved higher 



averages in both school -awarded 
marks and diploma examination marks 
than did mature students. 

Among all subgroups, regular students 
with no school -awarded marks 
achieved the highest average in 
diploma examination marks, while 



mature students with school marks 
brought forward achieved the lowest 
average. 



Table 4-1 

English 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


19 832 


86.9 


Mature Students 


2 990 


13.1 


Total 


22 822 


100.0 



Table 4-2 
English 30 

Diploma Examination Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


21 489 


64.8 


13.0 


Regular Students 


19 092 


65.7 


’ r *12.8 /; 


Mature Students 


2 397 


WilmM. ; 


- - ■ 

12.8 










Regular Students, School 








Mark Brought Forward 


499 


62.5 


12.9 


Mature Students, School 








Mark Brought Forward 


119 


51.4 


11.9 


Mature Students, 








Challenging Examination 


474 


59.8 


13.9 


Regular Students, 








No School Mark 


241 


71.0 


14.5 



Table 4-3 

English 30 

School- A warded Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


21 489 


68.4 


12.4 


Regular Students 
Mature Students 


19 092 
2 397 


69.1 

-v " ' ^ 4 '<« >' f \ s'- 

.■••• "*■■■■:■■< ■' - : -: 


12.0 




^ — 


. S .v V. -.. 




Regular Students, School Mark 








Brought Forward 


499 


68.0 


12.9 


Mature Students, School Mark 








Brought Forward 


119 


62.8 


11.1 



*For an explanation of the standard deviation, see footnote to Table 3-2, page 1 1 . 
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English 33: 1996-97 School Year 



Achievement in English 33 by 
subgroups is compared in Tables 4-4 to 
4-6. About one in six English 33 
students who wrote the 1996-97 
diploma examinations had mature status. 

Of students with current school-awarded 
marks, mature students achieved a 



higher average in school-awarded 
marks than did regular students; 
however, regular students achieved a 
higher average on the diploma 
examination than did mature students. 

Among all subgroups, mature students 
challenging examinations achieved the 



highest average in diploma 
examination marks. Subgroups with 
school marks brought forward 
achieved much lower averages in 
diploma examination marks compared 
with the other subgroups. 



Table 4-4 

English 33 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


10 893 


83.0 


Mature Students 


2 230 


17.0 


Total 


13 123 


100.0 



Table 4-5 
English 33 

Diploma Examination Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


12 465 


62.9 


11.7 


\ <RegularStudents s x 




| 63.2 


■ 1 1 .3 ' 


Mature Students . : 


.1 849 


61 1 


- ;13.8 \ 


Regular Students, School 
Mark Brought Forward 


159 


56.0 


10.7 


Mature Students, School 
Mark Brought Forward 


55 


46.7 


8.3 


Mature Students, 

Challenging Examination 


326 


65.0 


14.3 


Regular Students, 
No School Mark 


118 


64.3 


11.1 



Table 4-6 

English 33 

School -Awarded Marks for Population Subgroups 





Number of 






Standard 


Subgroup 


Students 


Average 




Deviation* 


All Regular School 


12 465 


61.4 




12.0 


Regular Students 

i| |1| ; Mature Students f | |: j{| j|| 


. ■ mf- IK 

.849 


61.2 

\. 4 • :'62-4| ; 


mm g 

4 'v * 

'• ;l ;: - 


<-: ft / 

12.7 


Regular Students, School Mark 










Brought Forward 


159 


53.1 




13.4 


Mature Students, School Mark 










Brought Forward 


55 


57.3 




7.7 



♦For an explanation of the standard deviation, see footnote to Table 3-2, page 11. 
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Social Studies 30: 1996-97 School Year 



Achievement in Social Studies 30 by 
subgroups is compared in Tables 4-7 to 
4-9. About one in sixteen Social 
Studies 30 students who wrote the 
1996-97 diploma examinations had 
mature status. 

Of students with current school- 
awarded marks, regular students 



achieved higher averages in both 
school-awarded marks and diploma 
examination marks compared with 
mature students. 

Among all subgroups, regular students 
with current school-awarded marks 
achieved the highest average on the 
examination. All subgroups with no 



current school-awarded marks 
achieved lower averages in diploma 
examination marks compared with 
regular school subgroups. 



Table 4-7 



Table 4-8 



Social Studies 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


18 167 


93.6 


Mature Students 


1 246 


6.4 


Total 


19413 


100.0 



Social Studies 30 

Diploma Examination Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


18 902 


64.3 


14.2 






" — — 


™ ^ ^ 


Regular Students 


17 800 


64.6 


14.2 






ililil 1 1 




Mature Students 


1 102 


58.6 


13.8 






* wvMM 




Regular Students, School 








Mark Brought Forward 


263 


55.7 


13.7 


Mature Students, School 








Mark Brought Forward 


44 


50.3 


14.4 


Mature Students, 








Challenging Examination 


100 


54.3 


14.1 


Regular Students, 








No School Mark 


104 


55.4 


16.2 



Table 4-9 

Social Studies 30 

School- Awarded Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


18 902 


69.1 


12.1 


ir ■ *“ 7' 7 r ^ t. i ‘ 

|!|||^gular Students . , ; \ . 


: 


• . •••«. ^..-..v . . ■ . . .s.. -v 

$'VV" a v ' > 


11.9 

* ■ ‘ 4 : - 


Mature Students 

a . - v.'-v- 


.8 . i '' ' . 'V s sss, 

! 102 


: ' ' 62:9 : : 


13.7 


Regular Students, School Mark 






Brought Forward 


263 


61.9 


13.0 


Mature Students, School Mark 








Brought Forward 


44 


62.7 


11.9 



♦For an explanation of the standard deviation, see footnote to Table 3-2, page 11. 
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Social Studies 33: 1996—97 School Year 



Achievement in Social Studies 33 by 
subgroups is compared in Tables 4-10 
to 4-12. About one in twelve Social 
Studies 33 students who wrote the 
1996-97 diploma examinations had 
mature status. 



Of students with current school- 
awarded marks, regular students 
achieved higher averages in diploma 
examination marks than did mature 
students. There was no difference for 
school-awarded marks. 



Among all subgroups, regular students 
with current school-awarded marks 
achieved the highest average on the 
examination. Mature students with 
school marks brought forward 
achieved the lowest averages in 
diploma examination marks. 



Table 4-10 

Social Studies 33 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


12 272 


92.0 


Mature Students 


1 069 


8.0 


Total 


13 341 


100.0 



Table 4-11 

Social Studies 33 

Diploma Examination Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


12 886 


61.2 


12.9 










Regular Students 


11 939 


61.4 


• 12.7 


Mature Students , ' s v sJ 


947 




i4.2 r. 










Regular Students, School 








Mark Brought Forward 


185 


50.5 


12.2 


Mature Students, School 








Mark Brought Forward 


24 


38.3 


7.5 


Mature Students, 








Challenging Examination 


98 


60.5 


16.1 


Regular Students, 








No School Mark 


148 


58.7 


12.8 



Table 4-12 

Social Studies 33 

School -Awarded Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


12 886 


61.1 


11.4 










“xo Regular Students ^ ^ 


11939. 


61.1 


11.3 


. : . : 








Mature Students 


. 947 ' . T. i 




MkMS& 


Regular Students, School Mark 








Brought Forward 


185 


52.3 


10.8 


Mature Students, School Mark 








Brought Forward 


24 


53.0 


7.2 



*For an explanation of the standard deviation, see footnote to Table 3-2, page 1 1 . 
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Mathematics 30: 1996-97 School Year 



Achievement in Mathematics 30 by 
subgroups is compared in Tables 4-13 
to 4-15. About one in seven 
Mathematics 30 students who wrote 
the 1996-97 diploma examinations 
had mature status. 

Of students with current school- 



awarded marks, regular students 
achieved higher averages in both 
school-awarded marks and diploma 
examination marks than did mature 
students. 

Among all subgroups, regular students 
with school marks brought forward 



achieved the highest average on the 
diploma examination, while mature 
students challenging the examination 
obtained the lowest average. 



Table 4-13 

Mathematics 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


15 994 


86.7 


Mature Students 


2 448 


13.3 


Total 


18 442 


100.0 



Table 4-14 
Mathematics 30 

Diploma Examination Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


17 589 


62.2 


17.9 


Regular Students vt 's'ift «|1 : ''p;^ ^ 


15 418 


63.3 


; ; 17.8 


Mature Students 


mm 

*— < i 
<N 


54.7 


16.9 










Regular Students, School 








Mark Brought Forward 


518 


65.9 


17.6 


Mature Students, School 








Mark Brought Forward 


139 


50.9 


15.0 


Mature Students, 








Challenging Examination 


138 


45.7 


19.3 


Regular Students, 








No School Mark 


58 


46.2 


20.8 



Table 4-15 

Mathematics 30 

School-Awarded Marks for Population Subgroups 




*For an explanation of the standard deviation, see footnote to Table 3-2, page 11. 
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Mathematics 33: 1996—97 School Year 



Achievement in Mathematics 33 by 
subgroups is compared in Tables 4-16 
to 4-18. About one in seven 
Mathematics 33 students who wrote 
the 1996-97 diploma examinations 
had mature status. 



Of students with current school- 
awarded marks, mature students had 
slightly higher averages on both the 
diploma examination marks and the 
school-awarded marks. 



Among all subgroups, mature students 
with current school marks achieved 
the highest average on the diploma 
examination, while mature students 
with school marks brought forward 
achieved the lowest average. 



Table 4-16 

Mathematics 33 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


9 948 


85.8 


Mature Students 


1 641 


14.2 


Total 


11 589 


100.0 



Table 4-17 

Mathematics 33 

Diploma Examination Marks for Population Subgroups 




Table 4-18 

Mathematics 33 

School-Awarded Marks for Population Subgroups 




*For an explanation of the standard deviation, see footnote to Table 3-2, page 11. 
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Biology 30: 1996-97 School Year 



Achievement in Biology 30 by 
subgroups is compared in Tables 4-19 
to 4-21. About one in ten Biology 30 
students who wrote the 1996-97 
diploma examinations had mature 
status. 

Of students with current school- 



awarded marks, mature students 
achieved lower averages in both 
school-awarded marks and in diploma 
examination marks compared with 
regular students. 

Among all subgroups, regular students 
with no school-awarded marks 



achieved the highest average on the 
diploma examination. Mature students 
with school marks brought forward 
achieved the lowest average on the 
diploma examination. 



Table 4-19 
Biology 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


15 459 


89.7 


Mature Students 


1 777 


10.3 


Total 


17 236 


100.0 



Table 4-20 
Biology 30 

Diploma Examination Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


16 701 


66.1 


16.8 


'if Regular Students ' 1 


•5rf| fjf 


66.8 


16.8 


Mature Students 


1 612 


60.3 


15.9 


Regular Students, School 








Mark Brought Forward 


284 


58.6 


16.0 


Mature Students, School 








Mark Brought Forward 


48 


50.0 


14.4 


Mature Students, 








Challenging Examination 


117 


53.6 


19.7 


Regular Students, 








No School Mark 


86 


67.2 


19.4 



Table 4-21 
Biology 30 

School-Awarded Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


16 701 


69.3 


13.4 


Regular Students 






13.2 


HI OHil Sill!! ■■■I lliiliill 

Mature Students 


■ 1 612 


;; : 765.5 ^ : 


|gl|ll 
Si ■ 

UJ 

ill 


- ■ 




. ...s . 




Regular Students, School Mark 








Brought Forward 


284 


65.9 


13.3 


Mature Students, School Mark 








Brought Forward 


48 


63.3 


12.7 



♦For an explanation of the standard deviation, see footnote to Table 3-2, page 1 1 . 
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Chemistry 30: 1996-97 School Year 



Achievement in Chemistry 30 by 
subgroups is compared in Tables 4-22 
to 4-24. About one in nine Chemistry 
30 students who wrote the 1996-97 
diploma examinations had mature 
status. 

Of students with current school- 



awarded marks, regular students 
achieved higher averages in both 
school-awarded marks and diploma 
examination marks than did mature 
students. 

Among all subgroups, regular students 
with no school-awarded marks 



achieved the highest average on the 
diploma examination. Mature 
students challenging the examination 
achieved the lowest diploma 
examination average. 



Table 4-22 

Chemistry 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


13 496 


89.4 


Mature Students 


1 596 


10.6 


Total 


15 092 


100.0 



Table 4-23 
Chemistry 30 

Diploma Examination Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


14 662 


63.4 


16.2 


Regular Students 






16.2 


Mature Students 


1 454 




15.3 










Regular Students, School 








Mark Brought Forward 


261 


62.7 


16.0 


Mature Students, School 








Mark Brought Forward 


62 


52.5 


14.7 


Mature Students, 








Challenging Examination 


80 


45.0 


15.2 


Regular Students, 








No School Mark 


27 


64.1 


17.0 



Table 4-24 
Chemistry 30 

School- Awarded Marks for Population Subgroups 





Number of 




Standard 


Subgroup 


Students 


Average 


Deviation* 


All Regular School 


14 662 


69.2 


13.9 


!gg||j 

Mature Student? 


iiiiiiiii 


'’gr'ftys'f 1 

69.7 

65.0 


13.7 

* ' C Z4&&- £ 

14.8 




... 






Regular Students, School Mark 








Brought Forward 


261 


68.3 


14.7 


Mature Students, School Mark 








Brought Forward 


62 


62.5 


15.5 



*For an explanation of the standard deviation, see footnote to Table 3-2, page 1 1. 
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Physics 30: 1996-97 School Year 



Achievement in Physics 30 by 
subgroups is compared in Tables 4-25 
to 4-27. About one in ten Physics 30 
students who wrote the 1996-97 
diploma examinations had mature 
status. 

Of students with current school- 
awarded marks, regular students 



achieved higher averages in both 
school-awarded marks and diploma 
examination marks than did mature 
students. 

Among all subgroups, regular students 
with current school- awarded marks 
achieved the highest average on the 
diploma examination. 



Mature students with school marks 
brought forward and mature students 
challenging the examination had the 
lowest averages on the diploma 
examination. 



Table 4-25 

Physics 30 

Status of Students Writing 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


7 669 


90.4 


Mature Students 


814 


9.6 


Total 


8 483 


100.0 



Table 4-26 
Physics 30 

Diploma Examination Marks for Population Subgroups 





Number of 


Average 


Standard 


Subgroup 


Students 




Deviation* 


All Regular School 


8 243 


64.9 


17.0 


^ ^ Y'"' 


v ■ 




— r- = — Terror 


Regular Students 


7 511 


65.4 

E - 




Mature Students 


732 


59.3 . 


■ 16 : 6 


Regular Students, School 








Mark Brought Forward 


126 


63.3 


14.8 


Mature Students, School 








Mark Brought Forward 


21 


54.7 


17.9 


Mature Students, 








Challenging Examination 


60 


52.0 


21.0 


Regular Students, 








No School Mark 


30 


58.3 


18.2 



Table 4-27 
Physics 30 

School-Awarded Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


8 243 


71.7 


13.4 

ISlllil 

ms** 


x Regular Students ' - 

Mature Students 

Regular Students, School Mark 
Brought Forward 

Mature Students, School Mark 
Brought Forward 


7 511 

' * V' 4 732 : 

J v..' .. 3 

126 

21 


72.2 


70.9 

65.7 


13.2 

17.3 



*For an explanation of the standard deviation, see footnote to Table 3-2, page 11. 
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Science 30: 1996-97 School Year 



Achievement in Science 30 by 
subgroups is compared in Tables 4-28 
to 4-30. About one in seventeen 
Science 30 students who wrote the 
1996-97 diploma examinations had 
mature status. 

Of students with current school- 
awarded marks, regular students 



achieved a slightly higher average on 
school-awarded marks. Mature 
students achieved a higher average on 
the diploma examinations. 

Among all subgroups, mature students 
with current school-awarded marks 
achieved the highest average on the 
diploma examination. Mature 



students challenging examinations had 
the lowest average marks on the 
diploma examination. 

These results may be unstable due to 
the small size of each subgroup and 
therefore should be interpreted with 
caution. 



Table 4-28 



Table 4-29 



Science 30 

Status of Students Writing 



Science 30 

Diploma Examination Marks for Population Subgroups 



Type of Student 


Number of 
Students 


Percentage 


Regular Students 


1 019 


94.1 


Mature Students 


64 


5.9 


Total 


1 083 


100.0 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


1 059 


62.0 


13.7 


Regular Students 


1 001 


61.9 


13.7 




» '*$? fry*' 






k k Mature Studenis : 


58 


63.5 


13.4 


. ■: :* : . . . . x . s-.-.-., . x ... ■ ..... — . ! ■ . . 








Regular Students, School 








Mark Brought Forward 


16 


57.6 


14.1 


Mature Students, School 








Mark Brought Forward 


2 


51.0 


18.4 


Mature Students, 








Challenging Examination 


4 


35.0 


9.7 


Regular Students, 








No School Mark 


2 


49.0 


12.7 



Table 4-30 
Science 30 

School-Awarded Marks for Population Subgroups 



Subgroup 


Number of 
Students 


Average 


Standard 

Deviation* 


All Regular School 


1 059 


61.6 


11.7 






'V $«*K!5gr 'i aw* - §£<**>* 




Regular Students ' 


1 001 


61.7 




Ilf M ature Students PS 


58 


60.0 J; : i 


12.2 


Regular Students, School Mark 


* u 




^ 1' 


Brought Forward 


16 


54.9 


11.1 


Mature Students, School Mark 








Brought Forward 


2 


64.5 


19.1 



♦For an explanation of the standard deviation, see footnote to Table 3-2, page 1 1. 
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Summary 



Does the percentage of mature 
students writing diploma 
examinations vary across courses? 

In 1996-97, the percentage of mature 
students writing examinations ranged 
from 5.9% in Science 30 to 17.0% in 
English 33. 

How does the performance of mature 
students with current school-awarded 
marks compare with the performance 
of regular students with current 
school-awarded marks? 

In 1996-97, average marks on diploma 
examinations for regular students with 
current school-awarded marks were 



higher than the averages for mature 
students with current school-awarded 
marks in all courses except 
Mathematics 33 and Science 30. 



How does the performance of 
mature students challenging the 
examination compare with the 
performance of other mature 
student subgroups? 

On the 1997 diploma examinations, 
mature students challenging the 
diploma examination achieved the 
highest average in English 33 but the 
lowest average in Mathematics 30, 
Chemistry 30, Physics 30, and Science 
30. 



For subgroups with current school- 
awarded marks and diploma 
examination marks, how does the 
diploma examination mark average 
compare with the school-awarded 
mark average? 

Both subgroups had higher averages in 
school-awarded marks than in diploma 
examination marks, with the following 
exceptions: regular students in English 
33, Social Studies 33, and both regular 
and mature students in Mathematics 33 
and Social Studies 30. 
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Section 5 

Special Study: Achievement-Over-Time for 
English 30 and Social Studies 30 Diploma 

Examinations 
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Introduction 

An important goal at Alberta Educa- 
tion is to answer the question: 

Has student achievement, as 
measured by the diploma examina- 
tions, changed over time? 

Since new diploma examinations are 
developed each year, it is not possible 
to make direct comparisons of 
achievement from one year to the 
next. Readministration of past 
diploma examinations would not give 
an accurate indication of changes to 
student performance because many 
students have access to past examina- 
tions for practice and review. 

This year, to answer the question in 
English 30 and Social Studies 30, the 
Student Evaluation Branch used three 
approaches to examine changes in 
student performance. The first method 
employed a statistical method called 
“linear equating” which allows us to 
compare multiple-choice test scores 
over time. This method has been used 
each year since 1 989 to track changes 
in achievement. The second method 



involved a study of the written- 
response sections of the 1992 and the 
1997 diploma examinations in these 
two subjects. This method was last 
used in 1991. Frequency distributions 
of written-response scores and 
descriptions from experienced markers 
provided information on how stu- 
dents’ writing has changed. Finally, 
information on the percentage of 
students achieving standards and on 
participation rates from 1990 to 1997 
was explored. Together, these three 
methods present a picture of how 
student performance on English 30 
and Social Studies 30 diploma 
examinations has changed over time. 

Multiple-Choice 

Section 

To identify if there have been changes 
in student performance on the 
multiple-choice section of the diploma 
examinations, the student scores on 
the June diploma examinations for 
each year are equated to the baseline 
year of 1992. In order to equate the 
scores from one year to another, we 

Table 5-J 



need to have a common reference 
point. Each June, a common anchor 
test is administered to a sample of 
students who are taking diploma 
examinations. The anchor tests are 
designed and developed to be parallel 
to the multiple-choice components of 
each diploma examination. They 
consist of a set of questions having the 
same content and focus as the 
multiple-choice component of the 
diploma examination. 

The questions from these anchor tests 
are not released to the public and are 
administered again in subsequent 
years. Following the administration 
and scoring of the diploma examina- 
tions, a student’s anchor test mark is 
matched with his or her multiple- 
choice section on a diploma examina- 
tion. 

Table 5-1 presents the number of 
English 30 and Social Studies 30 
students who wrote the anchor tests 
each year from 1989 to 1997. Only 
students with current school-awarded 
and diploma examination marks are 
included in the samples. 



Number of Students Writing the Anchor Tests 
for English 30 and Social Studies 30 from 1989 to 1997 





1989 


1990 


1991 


1992 


1993 


1994 


1995 


1996 


1997 


English 30 


360 


319 


297 


352 


364 


207 


346 


285 


270 


Social Studies 30 


634 


464 


303 


378 


327 


238 


309 


220 


296 




3 AO, 
( 
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Equating Procedure 

To place the results of different tests 
on the same scale, all scores are 
reported on the score scale from a 
baseline year. The baseline year for 
the diploma examination program is 
1992. Linear equating is used to 
equate the results from each diploma 
examination to the baseline. 

The equating method allows a 
student’ s score to be transformed onto 



the scale of the baseline year. That is, by 
applying the equating function calculated 
for English 30 students who wrote the 
June 1997 administration of the examina- 
tion, it is possible to transform that score 
onto the June 1 992 English 30 score scale 
as a way of comparing achievement over 
time. 

Results 

Table 5-2 and Figure 5-1 show the mean 
percentage scores equated to the 1 992 

Table 5-2 



scores for the multiple-choice 
component of the diploma exami- 
nations in this study. These scores 
can be used to compare the 
provincial student achievement of 
each year. Differences are consid- 
ered significant when the probabil- 
ity due to chance is equal to or less 
than 1% (p = 0.01). 



Equated Mean Percentage Scores on the Multiple -Choice Component of the Diploma 

Examinations from 1989 to 1997 





1 1989 


1990 


f 1991 ~ 


1992' 


1993 


1994 


1995 


1996 


1997 


English 30 


68.5 


68.1 


68.2 


67.5 


69.3 


69.4 


70.0 


71. 2? 


66.7 3 


Social Studies 30 


63.8 


64.4 


66.4 


65.4 


68.2 4 


66.3 


68.1 5 


67.3* 


6i.i 



baseline year: actual percentage on machine- scored component of diploma examination. 
2 Equated mean is significantly larger than means for 1989 to 1992 and 1997. 

3 Equated mean is significantly smaller than means for 1995 and 1996. 

Equated mean is significantly larger than means for 1989, 1990, and 1992. 

5 Equated mean is significantly larger than means for 1989, 1990, and 1992. 

6 Equated mean is significantly larger than mean for 1989 and 1990. 

7 Equated mean is significantly larger than mean for 1989 and 1990. 



Figure 5-1 



Achievement-Over-Time Results on the Multiple-Choice Section 
of the English 30 and Social Studies 30 Diploma Examinations 
from 1989 to 1997 
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Has achievement, as measured by the 
multiple-choice component of the 
diploma examinations, changed over 
the past few years? 

• In English 30, the level of achieve- 
ment on the multiple-choice compo- 
nent of the diploma examination has 
remained fairly constant from 1989 to 
1997. Achievement was significantly 
higher in 1996 than in 1989, 1990, 
1991,1992, and 1997. Although the 
level of achievement in 1997 is the 
lowest since the achievement-over- 
time study began, it is only signifi- 
cantly lower than 1996 and 1995. 
Whether this lower achievement in 
1997 represents a trend will not be 
known until results for 1998 can be 
analyzed. 

• In Social Studies 30, there has been a 
gradual improvement in student 
performance from 1989 to 1997. The 
1993 and 1995 levels of achievement 
were significantly higher than the 

1989 and 1990 levels. The level of 
achievement in 1993 was signifi- 
cantly higher than the 1992 results, 
and the 1996 results were signifi- 
cantly higher than the 1989 results. 
The 1997 level of achievement was 
significantly higher than the 1989 and 

1990 levels. 

• Despite the statistical significance of 
differences that occur between some 
years, as a whole, the change in 
equated mean from 1989 to 1997 in 
both Social Studies 30 and English 30 
is very slight, as Figure 5-1 demon- 
strates. 

Written Response 

Section 

The written response assignments of the 
English 30 and the Social Studies 30 
diploma examinations are different for 
each examination. On both examina- 
tions, the written-response component is 
scored on a number of five-point scales 
(5 being excellent to 0 being Poor/ 
Insufficient/No Response). Although 
the descriptions of the characteristics of 
writing at each scale point do not 
:hange significantly from year to year, 



the examples of student work used 
to help markers understand the scale 
points are drawn from each adminis- 
tration of the examination. The 
questions being examined in this 
study were: 

• Did the standards applied to 
students’ writing change between 
1992 and 1997? 

• Has student achievement of the 
standards changed? 

• Are the characteristics of the 
students’ writing the same? 

Procedure 

The 1997 Achievement-Over-Time 
Written-Response Study is a 
descriptive study that examined the 
characteristics of student writing in 
English 30 and Social Studies 30 in 
1992 and in 1997 to discern which 
changes, if any, occurred. This 
study is similar to the 1991 
Achievement-Over-Time study. The 
study utilized experienced markers 
in both Social Studies 30 and 
English 30 to describe the character- 
istics of student writing in those 
subjects. For the study, 1,000 
sample papers were drawn from the 
1992 papers and another 1,000 from 
the 1997 papers. From these 
samples, comparisons were made at 
two standards: papers that received 
Satisfactory (3) throughout and 
papers that received Excellent (5) 
throughout. 

For this descriptive study, teachers 
first worked in pairs to describe 
sample papers in three general 
categories designed to reflect 
curriculum expectations: Thought- 
fulness, Effectiveness, and Correct- 
ness. The markers’ focus was on the 
characteristics of the writing, not on 
grading the papers since only papers 
that had received either 3 or 5 from 
both original markers on each 
scoring category were considered. 
Each pair of markers described the 
1992 and the 1997 Satisfactory 
papers, reported their findings to the 
subject group, and then the com- 
bined the English and Social Studies 
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group findings. The process was 
repeated for the Excellent papers. 

Results 

In order to answer the question “Has 
student achievement, as measured by 
the diploma examinations, changed 
over time?”, it was necessary to 
review examination topics and criteria 
to determine if tasks and standards had 
changed. After a thorough review of 
scoring criteria, assignment wording, 
and students’ work, teachers in both 
subjects concluded that the standards 
applied in 1992 are consistent with 
those applied in 1997. In other words, 
papers receiving scores of 3 or 5 on a 
scoring category in 1992 would have 
received the same scores in 1997 and 
vice versa. 

Teachers observed differences in the 
characteristics of student writing. The 
Social Studies 30 teachers found that 
while standards have not changed 
significantly since 1992, students who 
wrote at a Satisfactory level were, in 
1997, somewhat more likely to 
attempt to individualize their thought 
and expression, and students who 
wrote at the Excellent level were more 
likely to successfully demonstrate 
creativity and autonomy. The English 
30 teachers found similar trends. 

The question then became “If the 
standards are basically the same, are 
more or fewer students able to achieve 
these standards?” Figures 5-2 and 5-4 
present a comparison of 1992 and 
1997 written-response score distribu- 
tions on the English 30 and Social 
Studies 30 diploma examinations, 
respectively. Figures 5-2 and 5-3 
indicate that in 1997 a greater percent- 
age of students in English 30 achieved 
the standard of excellence than in 
1992 and about the same percentage 
achieved the acceptable standard. The 
pattern for Social Studies 30, shown in 
Figures 5-4 and 5-5, indicate that a 
greater percentage of students 
achieved both standards in 1997 than 
in 1992. 



28 



Percent of Students 



Figure 5-2 

English 30 

Line Graph Comparison of 1992 and 1997 Student Performance 
on the Written-Response Section 
of the English 30 Diploma Examination 




Figure 5-3 



English 30 

Bar Graph Comparison of 1992 and 1997 Student Performance 
on the Written-Response Section 
of the English 30 Diploma Examination 
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Figure 5-4 
Social Studies 30 

Line Graph Comparison of 1992 and 1997 Student Performance 
on the Written-Response Section 
of the Social Studies 30 Diploma Examination 




Figure 5-5 
Social Studies 30 

Bar Graph Comparison of 1992 and 1997 Student Performance 
on the Written-Response Section 
of the Social Studies 30 Diploma Examination 
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Diploma Examination 
. Results 

The review of diploma examination 
results by themselves does not give a 
picture of whether achievement has 
changed over time because the 
examinations are different each year. 
In spite of the examination develop- 
ment process efforts to keep the 
standards constant, slight changes in 
the standards from year to year can 
make it appear that student perform- 
ance has changed when actually the 
change was in the examination. 
However, the actual examination 
results do complement the study by 
showing that standards have 
remained constant. 

Table 5-3 provides both the percent- 
age of students achieving standards 
and participation rates for English 
30 and Social Studies 30. Unlike the 
other two studies, which only looked 



at June results, these results are for 
the entire school year. Both achieve- 
ment data and participation data 
were reviewed because of the 
interaction between the two sets of 
data. 

Results 

Overall, the percentages of students 
meeting standards on both the 
English 30 and Social Studies 30 
diploma examinations from 1990 to 
1997 are very similar. This corre- 
sponds with the trends found in the 
achievement-over- time multiple- 
choice analysis. Between 1992 and 
1997, participation rates in both 
English 30 and Social Studies 30 
have been declining. 

In English 30, the slight decline in 
the percentage of students achieving 
the acceptable standard in 1997 
corresponds to the information 
obtained from the multiple-choice 



analysis, which showed a decline in 
student performance in June 1997. Also, 
the slight increase in the percentage 
achieving the standard of excellence in 
1997 corresponds to the finding of the 
written-response analysis, which was 
that more students are achieving the 
standard of excellence in writing than 
did so in previous years. The percentage 
of students achieving the standard of 
excellence and the acceptable standard 
in English 30 was greater in 1996 than 
in all other years. However, the partici- 
pation rate was lower in 1996 than in 
any other year. 

For 1997, Social Studies 30 results 
indicated a slight decrease in the 
percentage of students achieving the 
acceptable standard and the standard of 
excellence. This trend is confirmed by 
the multiple-choice achievement-over- 
time analysis. Unlike English 30, there 
does not seem to be a relationship 
between the percentage achieving 
standards and the participation rate. 



Table 5-3 

English 30 and Social Studies 30 Diploma Examination Results From 1990 to 1997 



English 30 


1990 


1991 


1992 


1993 


1994 


1995 


1996 


1997 


Percent Acceptable Standard 


89.6 


90.6 


89.0 


87.8 


87.2 


87.2 


91.4 


88.0 


Percent Standard of Excellence 


13.0 


9.3 


10.9 


9.6 


10.4 


12.7 


16.0 


13.9 


Participation based on previous Grade 1 1 


N/A* 


N/A 


61.4 


57.7 


56.0 


53.7 


50.9 


52.3 


Social Studies 30 


















Percent Acceptable Standard 


79.9 


84.2 


81.1 


79.9 


83.7 


83.7 


84.2 


83.7 


Percent Standard of Excellence 


14.5 


15.9 


13.5 


12.5 


14.5 


15.7 


17.7 


15.6 


Participation based on previous Grade 1 1 


N/A 


N/A 


57.0 


54.0 


52.8 


49.6 


50.0 


48.4 



*N/A indicates that this information was not collected during those years. 
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Conclusions 

Overall, the three sources of informa- 
tion provide several conclusions. The 
multiple-choice study suggests that 
the equated average from 1989 to 
1997 has not changed drastically from 
year to year. The equated average for 
English 30 reached a peak in 1996 
and went down significantly in 1997. 
The Social Studies 30 equated 
average is very similar for all years 
with a slight upward trend from 1989 
to 1997. 



The written-response study indicates 
that more students in English 30 
achieved the standard of excellence in 
1997 than did so in 1992. For Social 
Studies 30, more students achieved at 
both standards in 1997 than did so in 
1992. Experienced markers state that 
the marking of the written-response 
section on the English 30 and Social 
Studies 30 diploma examinations has 
remained very consistent from 1992 to 
1997. 
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Finally, the previous diploma exami- 
nation results provide additional 
information regarding the percentage 
of students achieving standards and 
participation rates for each year. There 
has been little change in the percent- 
age of students meeting standards in 
both diploma examinations, and there 
seems to be a downward trend in 
participation rates from 1992 to 1997. 
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Section 6 

Examiners’ Annual Summary Statements 






This section of the report describes 
how well students met performance 
standards in the eleven diploma 
examination courses. Each summary 
statement addresses three questions: 

• What are the characteristics of the 
student population that wrote the 
examinations? 



• What is the overall performance of 
students on the examinations? 

• Do the population and performance 
data reveal any significant trends? 

Consistent with most of the data 
presented in Sections 2 through 5, the 
data in this section of the report are 



based only on the results of students 
who had both diploma examination 
and school-awarded marks. 

Consequently, the figures provided 
here are slightly different from Figure 
2-2 on page 3, which describes a 
broader population. 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 22 107 students with 
corresponding school-awarded marks 
wrote the English 30 diploma 
examinations. This number, 
representing approximately 64% of all 
students writing English 30 or English 
33 diploma examinations in 1996-97, 
has increased by 503 (2.3%) students 
since 1995-96. 

English 30 is a course “appropriate for 
students intending to pursue further 
academic studies” ( Senior High School 
Language Arts 1982 Curriculum 
Guide , page 6). 



English 30 

Figure 6-1 

English 30 

Distribution of Diploma Examination Marks 
1996-97 School Year 




The English 30 population comprises 
more females than males. About 56% 
of students writing the English 30 
diploma examinations are female; 44% 
are male (see Section 3). 



In the last three years, about 8% of 
those writing English 30 were atypical 
in that they were either repeating 
English 30 or challenging English 30 
(see Table 6-1). Special studies have 
shown that students who rewrite 
English 30 without instruction usually 
do not improve their marks, although 
students who rewrite with instruction 
in courses other than English score 
average mark increases of 5 to 10%. 
Students who choose to challenge the 
examination without classroom 
instruction usually pass the 
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Students achieving the acceptable standard pgg|] Students achieving the 
jS&l but not the standard of excellence. KBi standard of excellence. 



examination but often do not achieve 
marks high enough to gain entrance to 
further academic studies. 

What is the overall performance of 
students on the examinations? 

The overall performance of students 
writing the English 30 diploma 
examinations during 1996-97 was 
similar to that in previous years. 

In 1996-97, a significant proportion of 
the students writing English 30 
(88.0%) attained diploma examination 
marks at or above the acceptable 
standard , and 13.9% attained diploma 



examination marks at or above the 
standard of excellence (see Figure 6-1). 
Although 12.0% did not achieve the 
acceptable standard , most of these 
students (9.5% of all students) attained 
marks ranging from 40% to 49%. Some 
of these students might achieve the 
acceptable standard if they were to 
receive further instruction. 



Acceptable Standard 

Students who achieved at or slightly 
above the acceptable standard on the 
Minor Assignment: Reader’s Response 
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to Literature were able to understand 
the reading selection presented in Part 
A: Written Response and were able to 
relate their personal responses to 
details from that selection. For the 
most part, their writing was organized 
effectively. 

In responding to the Major 
Assignment, students achieving at or 
slightly above the acceptable standard 
presented a clear controlling idea that 
reflected a basic understanding of the 
chosen literary work, but not always 
an understanding of the author’s 
purpose or the wider implications of 
the literature. That is, students located 
a character or characters who 



illustrated a quality suggested by the 
topic, but they usually did not explore 
what the author was saying through 
that character. 

Students achieving at or slightly above 
the acceptable standard organized their 
writing in a mechanical or functional 
way, giving clear direction to the 
reader. Although these students often 
simply recounted parts of the story, 
many understood the requirements of 
the assignment and successfully 
focused their discussion on relevant 
supporting details. Students writing at 
this standard usually used language in a 
correct, practical way to “get the job 
done” rather than to enhance the details 



that they were communicating or to 
illustrate ideas for the reader. 

As in the past, students at this 
standard continued to demonstrate 
some awareness of control of the 
stylistic choices and the conventions 
of written language. While such 
problems as pronoun-antecedent 
agreement and subject- verb 
agreement did appear in the writing, 
more pervasive and serious were 
errors involving word usage and 
confusion of syntax. However, the 
fact that students with final course 
marks in the mid-range (60% to 70%) 
can and do produce some well-written 
sentences suggests that they have the 
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English 30 Diploma Examination 

Five-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 1 2 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


2.4 


86.1 


7.0 


4.5 




Examination Average 


62.1 


65.2 


58.3 


60.2 


1995-96 


Percentage of Population 


2.6 


87.0 


7.5 


4.4 




Examination Average 


63.6 


67.4 


61.3 


62.3 


1994-95 


Percentage of Population 


2.1 


84.6 


8.6 


4.7 




Examination Average 


61.7 


65.0 


59.0 


60.2 


1993-94 


Percentage of Population 


1.5 


83.4 


10.0 


5.1 




Examination Average 


60.1 


63.7 


58.7 


58.8 


1992-93 


Percentage of Population 


1.7 


82.7 


10.1 


5.4 




Examination Average 


60.8 


63.5 


58.5 


58.5 



*This group includes repeaters, individuals challenging the examinations, and students without a school -awarded mark. 



Table 6-2 
English 30 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School -Awarded Mark 


24 489 


24 494 


23 074 


21 604 


22 107 


Male/Female Proportions (%) 


45/55 


45/55 


45/55 


45/55 


44/56 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


87.8 


87.2 


87.2 


91.4 


88.0 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


9.6 


10.4 


12.7 


16.0 


13.9 
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potential to move from “acceptable” to 
“proficient” in their writing. 

In responding to Part B: Reading , 
students who achieved at or slightly 
above the acceptable standard 
demonstrated that they were generally 
capable of effective close reading and 
of understanding difficult material, 
especially non-fiction. These students 
were often unsuccessful, however, on 
vocabulary and other complex 
questions requiring closer 
examination, recognition of contextual 
clues, and rereading of the passage. 

Standard of Excellence 

Students who achieved the standard of 
excellence on Part A: Wri tten 
Response produced writing that 
displayed confidence in ideas, 
organization, and choice of language. 
Writing at this standard reflected a 
sensitivity to the emotional tone of the 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 12 679 students with 
corresponding school-awarded marks 
wrote the English 33 diploma 
examinations. This is approximately 
36% of all such students who wrote the 
English 30 or English 33 diploma 
examinations in 1996-97. Generally, 
students who write English 33 write 
few, if any, other diploma 
examinations (see Figure 2-3). 

English 33 is a course “appropriate for 
students intending to go to vocational 
school or to seek employment after 
leaving high school” {Senior High 
School Language Arts 1982 
Curriculum Guide , page 6). The fact 
that so few English 33 students were 
enrolled in other diploma examination 
courses may indicate that these 
students did, indeed, plan to enter the 
workforce immediately upon 
graduation. 
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reading selection and also reflected an 
appreciation of the importance of 
lively, concrete detail in personal 
responses. Often, there was a mature 
understanding of the significance of 
the topic within the greater scope of 
human endeavor. 

In responding to the Major 
Assignment, students at this standard 
of achievement demonstrated a 
perceptive understanding of literature. 
They were able to use the topic as a 
springboard to a focused, engaging, 
thorough examination of a chosen 
work of literature. Students who 
achieved the standard of excellence 
were confident but thoughtful in 
presenting their ideas and opinions. 

In responding to Part B: Reading , 
students achieving the standard of 
excellence demonstrated that they had 
highly developed skills in close 
reading. These students also achieved 
noticeably higher scores on questions 



English 33 



In 1996-97, as in previous years, 
English 33 was selected by more male 
students than female students. Also, as 
can be seen in Table 6-3, atypical 
examination writers formed 8.8% of 
the total number of individuals who 
wrote English 33 diploma 
examinations in 1 996-97. This 
proportion is much higher than that for 
other diploma examinations (for 
example, 3.2% in Social Studies 30) 
and suggests that many individuals 
who are writing English 33 diploma 
examinations are challenging the 
examination or are repeating. The 
overall achievement of atypical 
examination writers is higher than the 
overall achievement for other groups, 
as shown in Table 6-3. Again, this is 
unusual for diploma examination 
courses in that the overall achievement 
of similar groups of atypical 
examination writers in other courses is 
generally lower than for the other 
groups shown in the tables. (See 
Tables 6-1, 6-3, 6-5, 6-7, 6-9, and 6- 
12 .) 
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requiring competence in vocabulary. 
Students at this standard were 
successful at reading critically and 
responding precisely to complex 
literary works such as Shakespearean 
drama and poetry dense with imagery. 

Do the population and performance 
data reveal any significant trends? 

Table 6-2 provides a comparison 
over the last five years of selected 
population and performance indicators. 
The increase in numbers between 
1992-93 and 1993-94 of students 
writing the diploma examination in 
English 30 ended in 1994-95. After 
another drop in 1 995-96, the numbers 
recovered somewhat in 1996-97. This 
may be a reflection of a trend toward 
retraining and restructuring in the 
workforce. 



What is the overall performance of 
students on the examinations? 

The overall performance of the 12 679 
students with corresponding school- 
awarded marks who wrote the English 
33 diploma examinations this past 
school year was generally satisfactory. 
In 1996-97, 86.2% of students writing 
English 33 attained diploma 
examination marks at or above the 
acceptable standard and 7. 1 % attained 
diploma examination marks at or above 
the standard of excellence (see Figure 6- 
2). The proportion of students who did 
not achieve the acceptable standard 
was 13.8%, but 1 1.0% attained marks 
ranging from 40% to 49%. Only 2.8% 
of the students attained marks of 39% 
or lower. 

Acceptable Standard 

Students who achieved at or slightly 
above the acceptable standard were 
able to respond clearly and correctly to 
all three assignments in Part A: Written 



Response. They demonstrated a clear 
understanding of the reading selection 
in their responses to Section I: 
Personal Response to Literature, and 
they addressed the assignment in a 
conventional manner. These students 
discussed life experiences and themes 
of understanding in the reading 
selection in their responses to this 
section in perfunctory but acceptable 
ways. 

Students achieving at or slightly above 
the acceptable standard provided 
satisfactory responses to Section II: 
Functional Writing. These students 
used the information provided in the 
assignment to fulfill their purposes 
sufficiently and were able to adopt an 
appropriate tone that demonstrated an 
awareness of audience. They were 
able to organize their work logically 
and clearly. 

When responding to Section III: 
Response to Visual Communication, 
these students tended to interpret the 
photograph in conventional ways, 
using generalized observations for 
support. Students who just met the 
acceptable standard on Part A: 

Written Response provided few 
specific details in their writing. 

Writing skills demonstrated by these 
students were minimally acceptable. 

In responding to Part B: Reading , 
students who achieved at or slightly 
above the acceptable standard were 
able to understand reading selections 



that were intended for a general 
audience. They were able to draw 
some inferences from context and to 
apply basic concepts such as metaphor 
and foreshadowing. However, these 
students had difficulty understanding 
and interpreting irony and other tonal 
qualities. 

In responding to the revision 
assignments on Part B: Reading , in 
which students were required to make 
decisions about appropriate revisions 
to the draft of a letter, many students 
achieving at or slightly above the 
acceptable standard appeared to 
understand the rationale behind 
revisions in areas such as syntax, 
diction, and conventions. What was 
discouraging was that many of these 
students did not transfer this apparent 
understanding to their own writing on 
Part A: Written Response. 

Standard of Excellence 

Students who achieved the standard of 
excellence generally produced work of 
superior quality on all of the 
assignments in Part A: Written 
Response. When responding to 
Section I: Personal Response to 
Literature, students at this standard 
usually interpreted the assignment in 
an insightful way. They presented 
significant themes or ideas and used 
precise examples from life and 
literature to support their themes. 

Many of these students responded to 
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Distribution of Diploma Examination Marks 
1996-97 School Year 
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the universal implications of the 
selections and explored topics in a 
perceptive manner. These students 
used precise, thoughtfully chosen, and 
often imaginative details. They were 
able to select examples and 
illustrations from reading selections, 
from their own experience, and from 
other literature to fulfill their purpose. 
Their writing was focused, coherent, 
and smoothly developed. They used 
words and structures that were 
effective and basically free from 
errors. These students projected 
confidence in their writing. 

When responding to Section II: 
Functional Writing, students achieving 
the standard of excellence used an 
appropriate and engaging tone. They 
provided significant information that 
was enhanced by appropriate details. 
These students had a precise 
awareness of audience, and they 
provided important and essential 
information necessary for their 
purpose. Writing skills demonstrated 
at this level were relatively even; word 
choice and sentence structure were 
appropriate and often effective, and 
there were few errors in mechanics 
and grammar. 

When responding to Section III: 
Response to Visual Communication, 
students achieving the standard of 
excellence presented insightful 
interpretations of the photograph, 
stating appropriate themes or ideas. 
Their ideas were typically extended 
and reinforced throughout their 
compositions. These students chose 
specific elements from the photograph 
to support their ideas. They made few 
mechanical or grammatical errors and 
produced relatively lengthy responses. 

When responding to Part B: Reading , 
students achieving the standard of 
excellence demonstrated an 
understanding of relatively 
complicated literature. They were 
able to delve beyond the literal level 
of a work to make inferences from 
important features such as irony and 
symbolism. These students 
demonstrated that they read carefully 
and thoughtfully the selections and all 
parts of each question before 
answering. 
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Do the population and performance 
data reveal any significant trends? 

Table 6-4 provides a comparison over 
the last five school years of selected 
population and performance indicators. 

The proportion of male and female 
students writing the English 33 
diploma examinations has remained 
relatively constant over the past five 



years, but the difference in proportion 
is unusual for diploma examination 
subjects (see Figure 3-1). 

The proportion of students achieving 
the acceptable standard in English 33 
declined between 1994—95 and 1995- 
96, but increased between 1995-96 
and 1996-97. The increase in the 
proportion of students achieving the 
standard of excellence between 1994— 



95 and 1996-97 bodes well, but it is 
too early to suggest that this increase 
is significant or that it indicates a 
“trend.” The low proportion of 
students achieving the standard of 
excellence in English 33 continues to 
be a concern and may indicate that 
few students taking this course are 
motivated to achieve high marks. 



Table 6-3 



English 33 Diploma Examination 

Five-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 12 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


6.7 


80.5 


8.8 


4.1 




Examination Average 


60.6 


62.7 


63.2 


61.1 


1995-96 


Percentage of Population 


6.5 


79.5 


9.7 


4.3 




Examination Average 


61.0 


63.0 


63.8 


60.8 


1994-95 


Percentage of Population 


5.7 


78.8 


11.3 


4.2 




Examination Average 


60.9 


61.9 


66.7 


60.1 


1993-94 


Percentage of Population 


4.8 


77.4 


13.5 


4.3 




Examination Average 


61.4 


61.1 


62.9 


59.7 


1992-93 


Percentage of Population 


5.1 


77.4 


12.6 


4.9 




Examination Average 


60.9 


61.9 


63.6 


60.0 



*This group includes repeaters, individuals challenging the examinations, and students without a school -awarded mark. 



Table 6-4 
English 33 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School- A warded Mark 


9 939 


11 020 


11 613 


11 381 


12 679 


Male/Female Proportions (%) 


58/42 


56/44 


56/44 


56/44 


56/44 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


86.2 


85.0 


86.1 


85.6 


86.2 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


5.5 


5.1 


5.1 


6.9 


7.1 
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Social Studies 30 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 19 209 students with 
corresponding school- awarded marks 
wrote the Social Studies 30 diploma 
examinations. Generally, students 
writing Social Studies 30 also wrote 
other diploma examinations (see Figure 
2-3). There is also a high correlation 
(0.725) between Social Studies school- 
awarded marks and Social Studies 30 
diploma examination marks (see 
Section 2, Table 2-1). 

Social Studies 30 is a course designed 
for those students who are seeking a 
diploma and who will likely pursue 
academic post-secondary studies. The 
fact that many Social Studies 30 
students took other diploma 
examination courses may indicate that 
most of these students plan to enter 
post-secondary institutions upon 
graduation. 

Social Studies 30 was selected by more 
female than male students. In 1996-97, 
10 158 female students and 9 051 male 
students wrote the Social Studies 30 
diploma examinations. Also, as can be 
seen in Table 6-5, the size of subgroup 
populations and their success on the 
Social Studies 30 diploma examinations 
have been relatively constant over the 
years. The group of atypical 
examination writers has, however, 
tended to perform below that of the 
other population subgroups. 



What is the overall performance of 
students on the examinations? 

The overall performance of the 19 209 
students with corresponding school- 
awarded marks who wrote the Social 
Studies 30 diploma examinations was 
satisfactory. In 1996-97, 83.7% of the 
students writing Social Studies 30 
attained diploma examination marks at 
or above the acceptable standard , and 
15.6% of the students attained diploma 
examination marks at or above the 
standard of excellence (see Figure 6-3). 
The proportion of students who did not 
achieve the acceptable standard was 
16.3%, but 12.1% of students attained 
marks ranging from 40% to 49%. The 




percentage of students whose marks 
were 39% or lower was 4.2%. 

Acceptable Standard 

In answering the multiple-choice 
questions in Part A of the examination, 
students who achieved at or slightly 
above the acceptable standard were 
able to recall and comprehend certain 
historical events or economic and 
political concepts. Students just meeting 
the acceptable standard experienced 
difficulty, however, with questions 
involving chronology, various critical 
thinking skills, and the application of 
knowledge to new or unfamiliar 
situations. In particular, these students 
experienced difficulty with textual or 
data-based questions (such as those 
involving a cartoon, graph, map, or 
series of quotations) that required them 
to see relationships, interpret trends, 
understand cause and effect, or identify 
stated or unstated assumptions. 

Many students who just met the 
acceptable standard had difficulty 
dealing with the complexity of the task 
on Part B: Written Response. Typically, 
these students presented largely 
descriptive essays containing both 
relevant and irrelevant detail. Many 
students who just met or who fell short 
of the acceptable standard had difficulty 
applying and integrating concepts and 
defining the issues. They appear to have 
rushed headlong into their writing. 



without planning their essays or 
considering the relevance of historical 
or contemporary examples associated 
with the issues under discussion. 

Students who fell short of the 
acceptable standard often presented 
memorized information at random, 
rather than a thought-out discussion. 
They left the task of sorting out 
scattered facts to the reader. They 
presented popularly accepted versions 
of past or present events as 
unsupported, simple assertions. They 
often made little attempt to elaborate, 
explain, or develop ideas. Such 
writing received low scores. 

Standard of Excellence 

In answering the multiple-choice 
questions in Part A, students 
achieving the standard of excellence 
demonstrated that they understood 
social studies concepts and 
comprehended historical, political, 
and economic relationships, many of 
which are very complex. They were 
consistently able to interpret and 
evaluate information and ideas, and to 
apply, analyze, and synthesize 
specific information. 

Students who achieved the standard 
of excellence often produced powerful 
and substantive writing in their 
responses to the assignment in Part B: 
Written Response. Given the 
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complexity of the task and the 
constraints of time, some of these 
students’ compositions were truly 
remarkable. Many of the responses of 
students achieving at this standard 
revealed qualities of argument, 
support, development, and 
organization that exhibited a breadth 
of historical and contemporary 
knowledge. Students achieving the 
standard of excellence clearly showed 
ownership of the ideas they expressed; 
their writing revealed engaged minds 
thoughtfully immersed in issues 
relevant and meaningful to them. 
These students were comfortable in 
exploring ideas in their complexity. 

Do the population and performance 
data reveal any significant trends? 

Table 6-6 provides a comparison over 
the last five school years of selected 
population and performance indicators. 



The number of students writing Social 
Studies 30 diploma examinations 
declined significantly from past 
administrations. Between 1993-94 
and 1996-97, for example, this 
decrease was 10.0%. The proportion 
of male and female students writing 
and the two performance indicators 
have remained relatively constant (see 
Table 6-6). 

Although more females than males 
wrote the diploma examination in 
Social Studies, males continued to 
achieve higher averages than females: 
67.1% compared with 63.1% in 1995- 
96, and 66.5% compared with 62.1% 
in 1996-97. On the multiple-choice 
component, in particular, males 
consistently achieve higher average 
scores than females: 69.4% compared 
with 63.3% in 1996-97. This 
difference is not evident in the written 
response, where the averages in 1996- 



97 were 59.0% forjmales and 58.7% for 
females. 

Student performance on the Social 
Studies 30 diploma examinations is 
showing improvement over performance 
in previous years. The proportion of 
students achieving the standards remains 
relatively constant. Revisions to the 
examination blueprint, beginning in 1990, 
have emphasized the demonstration of 
cognitively demanding, critical -thinking 
skills in both the multiple-choice and 
written components of the examination. In 
summary, it is encouraging that the 
proportions of students achieving 
standards have remained relatively 
consistent over the years. 



Table 6-5 



Social Studies 30 Diploma Examination 

Five-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 12 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


3.1 


89.6 


3.2 


4.1 




Examination Average 


62.0 


64.1 


58.6 


62.5 


1995-96 


Percentage of Population 


3.1 


89.4 


3.4 


3.8 




Examination Average 


62.1 


62.5 


56.9 


64.4 


1994-95 


Percentage of Population 


2.3 


88.9 


5.1 


4.0 




Examination Average 


63.6 


64.4 


57.7 


63.7 


1993-94 


Percentage of Population 


1.8 


87.1 


6.1 


4.5 




Examination Average 


60.5 


63.6 


57.2 


62.3 


1992-93 


Percentage of Population 


1.8 


88.0 


5.7 


4.4 




Examination Average 


60.5 


62.1 


60.0 


61.1 



♦This group includes repeaters, individuals challenging the examination, and students without a school -awarded mark. 



Table 6-6 

Social Studies 30 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School-Awarded Mark 


21098 


21 351 


19 745 


19 646 


19 209 


Male/Female Proportions (%) 


47/53 


47/53 


47/53 


47/53 


47/53 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


79.9 


83.7 


83.7 


84.2 


83.7 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


12.5 


14.5 


15.7 


17.7 


15.6 



o 
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Social Studies 33 



What are the characteristics of the 
student population that wrote the 
examinations? 

Diploma examinations in Social Studies 
33 were administered for the second 
time in the 1996-97 school year. These 
examinations were written by 13 095 
students with corresponding school- 
awarded marks. Generally, students 
who wrote the Social Studies 33 
examinations also wrote several other 
diploma examinations; however, the 
average number of diploma 
examinations written by these students 
was lower than that for most other 
diploma examination courses. Social 
Studies 33 is a course designed for 
students intending to seek employment 
immediately after completing high 
school or for students planning to attend 
a post-secondary education institution 
and to major in a field other than the 
social sciences. The fact that Social 
Studies 33 students were enrolled in 
few other diploma examination courses 
may indicate that many of these 
students did, indeed, plan to enter the 
workforce upon completion of high 
school. 

In 1996-97, Social Studies 33 was 
selected by slightly more male students 
than female students. 

Also, atypical examination writers 
formed 5.5% of the total number of 
students who wrote Social Studies 33 
diploma examinations in 1996-97. 
Although this proportion is lower than 
in English 33, it is somewhat higher 
than in Social Studies 30. This suggests 
that a significant proportion of those 
students who are writing Social Studies 
33 diploma examinations are 
challenging the examination or 
repeating the course. The overall 
achievement of atypical examination 
writers is marginally lower than that of 
other groups, a trend that is consistent 
with most other diploma examination 
courses. 



0 




What is the overall performance of 
students on the examinations? 

The overall performance of the 13 095 
students with corresponding school- 
awarded marks who wrote the Social 
Studies 33 diploma examinations was 
satisfactory. In 1996-97, the acceptable 
standard was achieved by 80.8% of 
students who wrote the Social Studies 33 
diploma examination, and the standard 
of excellence by 6.8%. The proportion 
of students who did not achieve the 
acceptable standard was 19.2%, but 
13.5% attained marks ranging from 40% 
to 49%. Only 5.7% of students attained 
marks of 39% or lower. 

Acceptable Standard 

In answering the multiple-choice 
questions, students at or slightly above 
the acceptable standard were 
able to recall and comprehend some 
historical events and basic political and 
economic concepts. They were also able 
to interpret and apply ideas and 
information presented in multiple-choice 
question data sources, although success 
diminished for the more complex and 
challenging sources and associated 
questions. 



The great majority of students who 
achieved at or slightly above the 
acceptable standard responded to 
each of the four writing assignments 
on their examination. The written 
work of these students showed that 
they had a basic understanding of 
social studies concepts and their 
application in real-world situations. It 
was relatively common for students at 
or slightly above the acceptable 
standard to correctly recall and apply 
factual information but to lack the 
breadth and depth of knowledge 
demonstrated by students achieving 
the standard of excellence. 

Responses were sincere, with many 
students developing links between the 
writing tasks and their own lives. 
Students who achieved at or slightly 
above the acceptable standard 
demonstrated satisfactory written 
communication skills. Written works 
typically contained appropriate but 
generalized vocabulary. Students at 
this standard demonstrated 
satisfactory control of sentence 
construction, grammar, and 
mechanics. Overall, such works were 
functionally organized and the 
student’s meaning was relatively 
clear. On the writing assignments, 
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Figure 6-4 

Social Studies 33 

Distribution of Diploma Examination Marks 
1996-97 School Year 
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student scores for the Communication 
of Ideas scoring category were, as a 
rule, slightly higher than for the Ideas 
and Support scoring category. 

Standard of Excellence 

In answering the multiple-choice 
questions in Part A, students achieving 
the standard of excellence 
demonstrated that they understood 
social studies concepts and 
comprehended fundamental historical, 
political, and economic relationships. 
They were able to interpret and 
evaluate information presented in 
relatively complex multiple-choice 
data sources with minimal difficulty. 

The written compositions of students 
achieving the standard of excellence 
typically provided a more panoramic 
perspective than the written 
compositions of students achieving at 
or slightly above the acceptable 



standard. Students achieving the 
standard of excellence not only 
developed links between a writing 
task and their own lives but also 
typically expanded upon this base to 
discuss the broader implications 
related to the task. Students at the 
standard of excellence demonstrated 
competent-to-excellent written 
communication skills. These students 
were able to use specific and 
appropriate vocabulary, and 
demonstrated confident control of 
sentence construction, grammar, and 
mechanics. The compositions of 
students achieving the standard of 
excellence were effectively organized, 
and students wrote so that their 
meaning was easily understood. 

Do the population and performance 
data reveal any significant trends? 

Given that Social Studies 33 diploma 
examinations have been administered 



for only two years, it is premature to 
discuss any significant trends. Student 
achievement in the first two years of 
administration has clearly met the 
expectations of the educational 
professionals involved in designing 
the examination and in applying the 
standards used to evaluate student 
achievement. 

It is interesting to note that there was a 
significant increase in the total 
numbers of students writing the 
examination. In the 1995-96 school 
year, the total number of examinations 
written was 1 1 894. This total 
increased for the 1996-97 school year 
to 13 095, an increase of slightly more 
than 9.1%. This increase may indicate 
that with the introduction of the 
diploma examination, Social Studies 
33 has become a more legitimate 
course option for students in Alberta. 



Table 6-7 



Social Studies 33 Diploma Examination 

Two-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 12 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


5.7 


84.6 


5.5 


4.2 




Examination Average 


60.6 


60.6 


59.8 


62.1 


1995-96 


Percentage of Population 


5.4 


85.2 


6.0 


4.4 




Examination Average 


60.1 


61.7 


61.8 


61.5 



♦This group includes repeaters, individuals challenging the examination, and students without a school -awarded mark. 



Table 6-8 

Social Studies 33 

Two-Year Comparison of Selected Population and Achievement Indicators 





1995-96 


1996-97 


Number of Students with a School- A warded Mark 


11 894 


13 095 


Male/Female Proportions (%) 


52/48 


51/49 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


83.1 


80.8 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


7.9 


6.8 
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What are the characteristics of the 
student population that wrote the 
examinations? 

Frangais 30 is the final course of the 
Frangais 10-20-30 program designed 
for francophone students as defined in 
Section 23 of the Canadian Charter of 
Rights and Freedoms. Students 
enrolled in Frangais 30 are required to 
write the Frangais 30 Diploma 
Examination. 

In the 1996-97 school year, there were 
85 regular school students who wrote 
the Frangais 30 diploma examinations. 
One mature student wrote the Frangais 
30 examination and 99 students from 
French immersion programs also 
challenged the Frangais 30 diploma 
examinations, for a total of 185 written 
examinations. Because very few 
students wrote at each administration, 
results must be interpreted with 
caution. 

What is the overall performance of 
students on the examinations? 

The overall performance of the 85 
regular school students who wrote the 
Frangais 30 diploma examinations in 
the 1996-97 school year was very 
good. All but two attained final course 
marks at or above the acceptable 
standard , and 14 achieved the 
standard of excellence . 



Frangais 30 

Most of the students enrolled in 
Frangais 30 wrote an average of five 
diploma examinations. This indicates 
that most of these students were 
hoping to receive the Advanced High 
School Diploma. 

La Partie A: Production ecrite 

The written-response section of the 
Frangais 30 diploma examinations 
required students to write two 
assignments related to a selection from 
a work of literature presented on the 
examination. The first assignment, 
“Premier sujet,” elicited a personal 
response to the selection. The second, 
“Deuxieme sujet,” asked students to 
select a work of literature studied in 
their high school Frangais courses and 
to relate it to a given theme inspired 
by the selection presented on the 
examination. 

Students were able to understand the 
tone and content of the given literature 
and to respond clearly and effectively. 
For the personal response, they 
expressed their opinions and reactions 
with confidence. Most took the more 
obvious approach to the question by 
supporting the given theme, and a few 
were able to present an opposing view 
successfully. Examples taken from 
their own experiences or from general 
observations were usually appropriate 
and often interesting. Although the 



writing of students just meeting the 
acceptable standard was sometimes 
wordy and repetitious, the meaning 
was clearly understandable. Students 
achieving the standard of excellence 
were able to present their ideas 
succinctly, directly, and emphatically. 

In the second assignment, students 
had no difficulty selecting works that 
reflected the given theme. Students 
achieving the standard of excellence 
used significant details from chosen 
literature to show how the given 
theme was developed by the author or 
authors. Students just meeting the 
acceptable standard tended to choose 
more minor details or to repeat one 
significant detail, with less effect. All 
students, however, were able to 
convince the readers of the 
relationship between what they had 
read and what the assignment 
required. Students have learned well 
how to organize their ideas, how to 
choose effective vocabulary and 
structures, and generally how to 
follow conventions of language. 

It must be remembered that students 
are writing in a limited time under 
examination conditions and that their 
work is considered a first draft. Under 
these conditions, what they achieved 
was impressive and often a pleasure 
to read. 



Figure 6-5 
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La Partie B: Comprehension ecrite 

The reading comprehension section of 
the Fran?ais 30 diploma examinations 
consisted of two booklets. The 
readings booklet contained selections 
from fiction, non-fiction, poetry, and 
drama. The questions booklet 
contained 70 multiple-choice 
questions based on these readings. The 
questions were classified according to 
thinking skills. 



Students’ performance was generally 
satisfactory. They were able to 
identify and select, infer, interpret, and 
evaluate main ideas. They were also 
able to recognize the author’s purpose, 
as well as to discern values expressed. 
Students achieving the standard of 
excellence seemed better able to 
discern the nuances required to choose 
the right answer in some questions. 
Students achieving the acceptable 
standard usually did well on the 
questions requiring a literal 
understanding. These students should 



be encouraged to refer back to the 
reading selections when contemplating 
their choice of answers. This could 
help them to perceive more of the 
nuances of the text. 

Do the population and performance 
data reveal any significant trends? 

Because the number of students 
enrolled in the course is extremely 
small, no comments can be made on 
trends in the data. 



Mathematics 30 



What are the characteristics of the 
student population that wrote the 
examinations? 

Mathematics 30 is a course “designed 
for students with an interest and 
aptitude in mathematics, who are 
intending to pursue post- secondary 
studies at a university or in a 
mathematics-intensive program at a 
technical school or college.” (Senior 
High School Mathematics 10-20-30 
Curriculum Guide, page 2). 

In 1996-97, 18 246 students with 
corresponding school -awarded marks 
wrote the Mathematics 30 diploma 
examinations. This is a decrease of 410 



students since 1995-96. The 
Mathematics 30 population comprises 
slightly more females than males: 
about 50.6%, compared with 49.4%. 

What is the overall performance of 
students on the examinations? 

Of the students writing Mathematics 
30 in 1996-97, 75.1% attained 
diploma examination marks at or 
above the acceptable standard , which 
is 0.8% higher than in the 1995-96 
school year, and 1.8% higher than in 
the 1 994—95 school year. 

The percentage of students who 
achieved the standard of excellence 



Figure 6-6 
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Distribution of Diploma Examination Marks 
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rose marginally from 19.1% in 1995-96 
to 19.2% in 1996-97 (see Figure 6-6). 
During the 1996-97 administrations, 
24.9% of the students did not achieve 
the acceptable standard , a decrease of 
0.8% from the 1995-96 administration 
(see Figure 2-14) and a decrease of 
1.6% from the 1994-95 administration. 

About 9.6% of the students who wrote 
the Mathematics 30 diploma 
examinations were rewriting the 
examination. Regular students scored 
an average of 63.3%, whereas regular 
students who rewrote the examination 
(school mark brought forward) scored 
an average of 65.9%. Regular mature 
school students scored an average of 
54.7%; whereas mature school students 
who rewrote the examination (school 
mark brought forward) scored an 
average of 50.9%. Mature students who 
challenged the examination scored an 
average of 45.7% (see Table 4-14). 

Standards for the Mathematics 30 
diploma examinations for the 1996-97 
school year were published in the 
Mathematics 30 Diploma Examination 
Information Bulletin. The emphases on 
problem solving and communication 
skills in the Mathematics 30 curriculum 
were incorporated into the examination. 
Students were expected to describe 
mathematical situations, explain their 
solutions and their reasoning, create new 
problems and strategies, generalize a 
mathematical situation, and formulate 
hypotheses. The Mathematics 30 
examiners’ reports outline the scoring 
criteria for these questions. 
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Acceptable Standard 

Students who achieved the acceptable 
standard of performance but not the 
standard of excellence (56%) were able 
to solve problems involving more than 
one step as long as the information 
provided was given in a “standard” 
form and could be referenced on the 
formula sheet. In permutations and 
combinations, for instance, students 
were able to calculate the number of 
linear, circle, or ring permutations, and 
permutations with repetitions of n 
things taken r at a time, but were not 
able to explain the reason that there are 
different numbers of permutations when 
a given number of objects is arranged in 
a line, a circle, or a ring, or when some 
of the objects are repeated or identical. 
For the most part, students in this group 
were able to recognize relationships 
between mathematical concepts, but 
only so long as these relationships were 
presented in a specific sense. Many 
were not able to identify the 
relationships in the general case. For 
example, these students were able to 
write the specific terms of an arithmetic 
or geometric sequence, given a defining 
function, but were not able to determine 
a function describing any sequence that 
has a recognizable pattern, nor were 
they able to identify and explain 
conditions necessary for a sequence to 
meet given requirements. 



What are the characteristics of the 
student population that wrote the 
examinations? 

Mathematics 33 is a course “designed 
for students who require mathematics 
to prepare them for many post- 
secondary programs at university, 
colleges, trades, and employment” 
(Senior High School Mathematics 13- 
23-33 Course of Studies, page 2). 

The Mathematics 33 examination has 
been designed to include scenarios 
that allow students to demonstrate 
their required mathematical 
understandings in situations similar to 
those they will encounter in post- 
secondary programs, colleges, trades, 
employment, and real life. 



Students who did not achieve the 
acceptable standard of performance on 
the Mathematics 30 diploma 
examinations (24.9%) had difficulty 
solving problems other than those that 
required solving for a single piece of 
information using a formula provided 
on the formula sheet. These students 
were able to solve problems that 
required a one-step calculation, such as 
finding the value of a z-score, given the 
values of the variables required to 
substitute into a given formula. 
However, these students were not able 
to complete multistep problems that 
required them to apply the z-scores of 
data normally distributed, such as the 
example given in the standards section 
of the Mathematics 30 Information 
Bulletin. 

Standard of Excellence 

Students who achieved the standard of 
excellence in Mathematics 30 (19.2%) 
had little difficulty solving any 
problems, regardless of the number of 
steps required. They recognized and 
were able to describe relationships 
between mathematical concepts in both 
the specific and the general cases. For 
example, given the first term and the 
common difference of an arithmetic 
sequence in the context of a problem, 
students who achieved at the standard 



Mathematics 33 

In the 1996-97 school year, 11 333 
students with corresponding school- 
awarded marks wrote the Mathematics 
33 diploma examinations. This is up 
approximately 1 000 students from the 
previous year. This year, about 50.4% 
of students writing Mathematics 33 
diploma examinations were female; 
49.6% were male. 

What is the overall performance of 
students on the examinations? 

In 1996-97, 81.2% of the students 
writing Mathematics 33 attained 
diploma examination marks at or 
above the acceptable standard. The 
percentage of students who achieved 
the standard of excellence was 17.7%. 
During the 1997 administration, 




44 55 



of excellence were able not only to 
algebraically determine specific 
answers to the problem, but were also 
able to clearly identify and explain, in 
a general manner, an expression for 
the total length of n. (Written 
Response 1, Mathematics 30 January 
1997 Diploma Examination.) 

Do the population and performance 
data reveal any significant trends? 

There has been an increase in the 
student population scoring at the 
acceptable standard on the diploma 
examination since 1994-95 as well as 
an increase in the student population 
scoring at the standard of excellence . 

On the written-response section of the 
examination, students achieving at the 
acceptable standard demonstrate some 
understanding of the problem, 
formulate some aspect of the problem 
mathematically, and demonstrate the 
use of a strategy that used 
mathematical knowledge and problem- 
solving techniques to find a partial 
solution. However, they demonstrate 
little understanding of the 
complexities of the problem, and the 
written-response section of the 
diploma examination continues to be 
an area where students will be 
required to show improvement in their 
solutions. 



18.8% of the students did not achieve 
the acceptable standard. 

Of students writing the examination 
85.8% were regular non-mature and 
14.2% were regular mature students. 
Only 3.3% of the students who wrote 
the Mathematics 33 diploma 
examinations were either challenging 
or rewriting the examination. Regular 
students scored an average of 63.7%, 
whereas regular students who rewrote 
the examination (school mark brought 
forward) scored an average of 54.9%. 
Regular mature students who wrote 
the examination scored an average of 
64.3%, whereas the 32 mature students 
who rewrote the examination scored 
an average of 50.3%. Mature students 
who challenged the examination 



scored an average of 57.4% (see Table 
4-17). 

Standards for the Mathematics 33 
diploma examinations for the 1996-97 
school year were published in the 
Mathematics 33 Diploma Examination 
Information Bulletin. 

In the 1 996-97 school year, students 
demonstrated strength on routine and 
non-routine conceptual, procedural 
and problem-solving tasks. These 
tasks were related to the standards and 
embedded within real-life contexts. 
Students successfully applied their 
mathematical understandings and 
articulated their mathematical abilities 
in performing tasks. Student 
responses to written questions 
demonstrated improved strengths in 
reasoning, analysis, formulating 
inferences, organizing/explaining 
solutions, and problem solving. The 
Mathematics 33 examiners’ reports 
outline student success on written- 
response questions, as well as on 
machine-scored questions related to 
these expectations. 



Acceptable Standard 

More students achieved the acceptable 
standard of performance but not the 
standa rd of excellence (63.5%) than 
did last year (59.9%). More students 
were able to solve problems written in 
both pure and applied contexts that 
involved demonstrating conceptual 
and/or procedural understandings. 

Students who did not achieve the 
acceptable standard of performance 
on the Mathematics 33 diploma 
examinations (18.8%) had difficulty 
solving problems that required the 
simple applications of conceptual and 
procedural understandings. Typically, 
they could not solve routine questions 
that require understanding of simple : 
concepts or procedures. 

Standard of Excellence 

Students who achieved the standard of 
excellence in Mathematics 33 (17.7%) 
had little difficulty solving problems 
and typically excelled at multistep 



Figure 6-7 
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tasks. They were able to do non- 
routine tasks readily. 

As well, they were able to formulate 
solutions, inferences, or 
generalizations from data, equations, 
graphs, and other nonroutine 
situations that presented themselves. 



Do the population and performance 
data reveal any significant trends? 



This was the second year that 
Mathematics 33 diploma examinations 
were administered. The results of the 
second year appear to be consistent 
with those of the first year, when 
averages are compared. However, 
more students are at the acceptable 
standard , and hence there is a 
decrease in the number of students not 
meeting the acceptable standard. 
Teachers marking the examinations 
noted their satisfaction in the ways 
students are responding, and 
improving to respond, to the 
examination questions. 

A recent advisory group of all 
stakeholders noted the examination 
and its format has improved student 
performance. The trend to use 
business and post-secondary partners 
in hosting teachers in the development 
of examination items has resulted in 
the growing recognition, 
improvement, and endorsement of 
students entering post- second ary 
opportunities. The advisory group 
endorsed the use and recognition of 
partnerships in developing real-life 
contexts. In summary, the various 
stakeholders stated that there is a 
significant improvement in student 
performance/attitudes and teacher 
expectations, when compared with 
years prior to the introduction of the 
Mathematics 33 diploma 
examinations. 



Students achieving the acceptable standard 
—„J but not the standard of excellence. 




Students achieving the 
standard of excellence. 
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Biology 30 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 17 033 students with 
corresponding school-awarded marks 
wrote the Biology 30 diploma 
examinations. This represents a slight 
decrease of 1.1% compared with 
1995-96; likely, the biology student 
population is stabilizing at around 
17 000 students per year. The writing 
population represents more than one- 
half of the students who wrote either 
the English 30 or Social Studies 30 
diploma examinations. 

Students who take Biology 30 are far 
more likely to take English 30 (57%) 
than English 33 (13%). Also, they are 
more likely to take Mathematics 30 and 
Social Studies 30 than Mathematics 33 
and Social Studies 33, respectively. 

Approximately 66% of the Biology 30 
population in 1996-97 completed four 
or more diploma examination courses. 
Compared with Chemistry 30 and 
Physics 30, Biology 30 has a lower 
proportion of students who write four 
or more diploma examinations during a 
school year, indicating that if students 
are choosing one science, that science 
is Biology. Notwithstanding this, 
Biology 30 is primarily intended for 
students intending to pursue post- 
secondary studies. Of science courses, 
50% of the Biology 30 population 
completed only one science diploma 
examination, 35% completed two, and 
15% completed three science diploma 
examinations. 

The Biology 30 population has more 
females than males. About 59% of 
students writing Biology 30 Diploma 
Examinations are female; 41% are 
male. 

What is the overall performance of 
students on the examinations? 

The overall performance of students on 
the Biology 30 diploma examinations 
during the 1996-97 school year was 
better than the previous year. This is 
reflected in the examination average 
(66.0%) and in the proportion of 



students (81.8%) who achieved the 
acceptable standard (see Figure 6-8). 
A good proportion of students (24.6%) 
achieved the standard of excellence. 
Although 18.2% of the students did 
not meet the acceptable standard , 
7.3% of all students obtained marks 
ranging from 45% through 49%. Most 
of these students would be able to 
achieve the acceptable standard on 
future diploma examinations in 
Biology 30 if they received additional 
instruction. 

The percentage of female and male 
students who achieved the acceptable 
standard on the Biology 30 diploma 
examinations was almost the same — 
82.2% for females and 81.3% for 
males. The percentage of female and 
male students who achieved the 
standard of excellence on the Biology 
30 diploma examinations was almost 
the same — 24.6% for females and 
24.5% for males. The Biology 30 
diploma examinations average for 
females and males was also almost the 
same — 66.1% for females and 65.9% 
for males (see Table 3-2). 

As in the previous four years, the 
group that attained the highest 
examination average (see Table 6-9) 
wrote Biology 30 diploma 



examinations while in their second 
year of high school. This group likely 
contains a high proportion of students 
who plan to take additional 30-level 
science courses in their third year of 
high school. 

Acceptable Standard 

Students who achieved the acceptable 
standard but not the standard of 
excellence (57.2% of the population) 
understood most of the basic functions 
of reproductive systems, cell division 
and Mendelian genetics, and 
differentiation and development. 
Biological concepts such as 
population genetics and interactions, 
molecular genetics, and nervous and 
endocrine systems proved difficult. 

This group of students correctly 
interpreted data presented in simple 
graphs, tables, and diagrams. 

However, they found it difficult to 
interpret complex graphs and tables 
that presented interrelated sets of data. 

They related biology concepts to 
simple human experiences but found it 
difficult to analyze multistep problems 
in molecular and population genetics. 
Questions that required the 
understanding of biology concepts 
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within the context of technology (how 
technology extended knowledge of 
cells or components of cells) proved 
difficult. The basic language of 
biology was understood by these 
students, but specialized terms that 
incorporate sophisticated science 
concepts (negative feedback, genetic 
engineering, reabsorption, hypothesis) 
created problems for them. They 
composed one- or two-sentence 
answers that were clear and logical for 
questions that contained only one 
component. However, they had 
difficulty creating multistep, 
paragraph responses to problems that 
required the development of several 
ideas. Their answers to these 
questions frequently consisted of 
recalled information that did not 
address the central issues of the 
problems posed. These students did 
not clearly express cause-and-effect 
relationships. 

Students who failed to achieve the 
acceptable standard (18.2%) did not 
understand basic functions of the 
nervous and endocrine structures, and 
had difficulty with molecular and 
population genetics and population 
interactions. They found it difficult to 
interpret data represented in diagrams 
and tables. They did not know the 
functional properties of key biological 
substances. They were unable to make 



predictions based on simple principles 
of inheritance and to sequentially 
organize the major steps of 
physiological processes. This group of 
students could not compose clear and 
logical explanations for single- 
component problems. Their responses 
indicated that they did not adequately 
understand the meaning of the 
questions. 

Standard of Excellence 

Students who attained the standard of 
excellence (24.6%) demonstrated 
consistent performance throughout the 
examination, whether they selected or 
created responses. They could recall 
precise knowledge about the structure 
and function of human organs, the 
mechanisms of inheritance, and 
populations. They could then use this 
knowledge to solve multistep problems. 
They were able to understand the 
chemical and neural pathways of 
communications, to understand all 
aspects of reproduction and genetics, 
and to arrange physiological processes 
in sequential order. They could perform 
calculations in molecular genetics and 
in population genetics and dynamics. 
They could form hypotheses based on 
initial data and then evaluate them in 
the light of new data. They could 
evaluate experimental designs and 
explain why the results could or could 



not be used to support certain decisions. 
Their compositions demonstrated a clear 
understanding of cause-and-effect 
relationships. They used scientific 
vocabulary with precision and 
communicated clearly. 

Do the population and performance 
data reveal any significant trends? 

From the 1992-93 to the 1996-97 school 
years, the total number of students who 
obtained a final course mark in Biology 
30 decreased from 21 604 to 17 033. 

The number of Grade 1 1 (second year of 
high school) students showed a large 
decrease in 1993-94, because of the 
implementation of the new Biology 20 
course. Since the former Biology 30 
course was not congruous with the new 
Biology 20 course, the majority of Grade 
1 1 students waited until their Grade 1 2 
year to enroll in Biology 30, thus 
causing a change in population size. In 
1996-97, the number of Grade 1 1 
students increased to 2 151; although 
this still represents a slight decrease in 
numbers from 1992-93, the proportion 
(12.7%) is slightly greater than it was in 
1992-93 (10.2%). 

The percentage of the population of each 
subgroup shows some changes as well. 
Over the five-year period, the proportion 
of Grade 12 (third year of high school) 



Table 6-9 

Biology 30 Diploma Examination 

Five-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 12 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


12.4 


80.9 


3.1 


3.6 




Examination Average 


72.0 


65.0 


57.5 


62.8 


1995-96 


Percentage of Population 


10.7 


82.1 


3.8 


3.4 




Examination Average 


66.8 


62.6 


54.2 


60.0 


1994-95 


Percentage of Population 


7.9 


83.8 


4.5 


3.8 




Examination Average 


72.6 


65.2 


55.6 


63.4 


1993-94 


Percentage of Population 


4.3 


84.4 


7.1 


4.2 




Examination Average 


71.1 


65.3 


59.0 


65.5 


1992-93 


Percentage of Population 


10.2 


79.5 


6.3 


4.0 




Examination Average 


69.4 


64.6 


59.4 


64.3 



*This group includes repeaters, individuals challenging the examinations, and students without a school-awarded mark. 
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Table 6-10 



Biology 30 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School- A warded Mark 


21 604 


17 943 


16 941 


17 225 


17 033 


Male/Female Proportions (%) 


42/58 


42/58 


41/59 


42/58 


41/59 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


81.6 


81.4 


80.9 


77.1 


81.8 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


22.1 


23.2 


24.2 


18.1 


24.6 



students slightly increased, then 
decreased to 80.9%. From 1993-94 to 
1996-97, the proportion of Grade 12 
(fourth year of high school) appears to 
be decreasing. Over the five-year 
period, the proportion of transferred -in 
students has remained relatively 
constant (see Table 6-9). 

From 1992-93 through 1996-97, the 
created -response section of the 
Biology 30 examinations changed in 
that increasing emphasis was placed 
on solving problems that were set in 
authentic science research contexts. 
Students were expected to solve these 
problems by using scientific process 



What are the characteristics of the 
student population that wrote the 
examinations? 

In the 1996-97 school year, 262 fewer 
students with corresponding school- 
awarded marks (14 985) wrote the 
Chemistry 30 diploma examinations 
than in 1 995-96. The male/female 
proportion of the writing population 
for Chemistry has remained relatively 
constant, with a larger female 
population, for a number of years (see 
Table 6-11). 



What is the overall performance of 
students on the examinations? 

The overall performance of students 
who wrote the Chemistry 30 diploma 



skills and by relating their 
understanding of science concepts to 
technological and societal issues. In 
keeping with these changes, the 
individual items were reduced in 
number (from four to two), but each 
item was increased in its breadth. The 
diploma examinations as a whole still 
remained accessible to the group of 
students who achieve at the acceptable 
standard as well as to those students 
who achieve at the standard of 
excellence . 

With the exception of the 1994-95 
school year, the percentages of 



Chemistry 30 

examinations during the 1996-97 
school year was satisfactory (see 
Figure 6-9). In 1996-97, 79.3% of the 
students writing Chemistry 30 attained 
diploma examination marks at or 
above the acceptable standard , which 
is down from 81.6% in 1995-96. A 
significant proportion of the students, 
17.7%, attained diploma examination 
marks at or above the standard of 
excellence (see Figure 6-9). This 
percentage is lower than the 18.1% of 
the students who achieved the 
standard of excellence in 1995-96. As 
in previous years, many of the students 
(9.5%) attained marks ranging from 
44% to 49%. These students could 
achieve the acceptable standard with 
further instruction. 

The percentage of female students who 
achieved the acceptable standard on 



students achieving the acceptable 
standard and those achieving the 
standard of excellence have remained 
about the same over the five years. 

The proportion of females and males 
who obtain Biology 30 diploma 
examination marks has changed very 
little during the past five school years. 
However, the proportion of females 
who achieved the acceptable standard 
in Biology 30 increased by 
approximately 2.2% since 1992-93, 
while the proportion of males who 
achieved the acceptable standard for 
this same period decreased by 2.5%. 



the Chemistry 30 diploma 
examinations was 78.0%, compared 
with 80.7% of male students. The 
percentage of females who achieved 
the standard of excellence on the 
examinations was 15.5%, compared 
with 20.2% of male students. The 
average for females on the Chemistry 
30 examinations was 62.3%, 
compared with 64.4% for males. 

These differences may be explained, 
in part, by the attractiveness to males 
of the technological emphasis in the 
new course. 

Acceptable Standard 

Students who achieved the acceptable 
standard but not the standard of 
excellence (61.6%) were able to do 
stoichiometry of more than one step as 
long as it did not involve writing and 





balancing equations for chemical 
reactions. They were able to calculate 
the amount of energy required to warm 
a given mass of water; the 
concentration of an acid, given the 
concentration and volume of the 
titrant; and the volume of acid, 
provided that the ratio between the 
sample and titrant was 1:1. They were 
able to assign oxidation numbers to 
most atoms and were capable of 
balancing chemical reactions using 
half-reactions. These students could 
transpose data to and from graphical 
form and had a good grasp of essential 
definitions and terms such as conjugate 
base, Arrhenius acid, pH, and 
exothermic-endothermic. They had 
little if any difficulty in adapting to the 
new linked question formats presented 
to them on the 1996 series of diploma 
examinations. They successfully 



ranked species on the basis of their 
properties, ranked reactions on the 
basis of the magnitude of the energy 
involved, and were able to use and 
extract pertinent information from the 
data booklet. However, they had 
difficulty recognizing ratios other than 
1:1 in acid-base chemistry, solving 
any calculation-based equilibrium 
problem, and solving complex 
stoichiometric problems. They 
usually recognized the correctness of a 
situation for most concepts, but had 
difficulty applying these concepts in 
unfamiliar contexts. They were weak 
in relating concepts to real-world 
circumstances. These students were 
usually able to organize their creative 
responses in an understandable 
fashion, though they had difficulty 
with communication conventions, 
such as spelling, significant digits, 
and, especially, SI prefixes. 



Figure 6-9 
Chemistry 30 

Distribution of Diploma Examination Marks 
1996-97 School Year 




These individuals worked best at the 
macroscopic level and, as a result, did 
well on the multiple-choice questions. 

Below Acceptable Standard 

Students who did not achieve the 
acceptable standard of performance on 
the Chemistry 30 diploma 
examination (20.7%) had difficulty in 
solving stoichiometric problems other 
than those involving single-step 
addition/subtraction problems, such as 
calculating the voltage of a cell given 
the half-reactions or determining the 
hydronium ion concentration given the 
pH. These students were unable to 
transfer data to or from graphical form 
or to use data to predict trends, 
patterns, or properties. They also had 
difficulty predicting chemical changes 
and writing appropriate chemical 
equations for the changes involved. 
Nor were they successful in relating 
their understanding of chemistry into a 
real-world context. In general, these 
students had difficulty creating their 
responses and communicating their 
ideas clearly. As a result, they did not 
do well on the created-response 
(numerical and written) sections of the 
examination. They did, however, 
recognize correct statements about 
essential concepts and had their 
greatest success on the multiple- 
choice section of the examination. 

Standard of Excellence 

Students who achieved the standard of 
excellence (17.7%) were able to solve 
any stoichiometric problem and to 
recognize ratios other than 1:1 in 
acid-base chemistry. They also 



Students achieving the acceptable standard |p||| Students achieving the 
iMM but not the standard of excellence . \Sm standard of excellence . 



Table 6-11 
Chemistry 30 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School- A warded Mark 


16 865 


14 424 


14 669 


15 247 


14 985 


Male/Female Proportions (%) 


48/52 


48/52 


48/52 


49/51 


48/52 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


81.6 


79.6 


84.0 


81.6 


79.3 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


21.1 


22.9 


20.2 


18.1 


17.7 
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recognized relationships between the 
dissolved solute and the resulting 
species and, as a result, were able to 
accurately predict physical and 
chemical properties of solutions. They 
had no difficulty in distinguishing 
between strength and concentration, 
nor did they have difficulty in 
inferring properties from graphical 
data. They were able to recognize 
when a reaction would or would not 
occur, and thus did not always assume 
that a reaction is forthcoming when 
two or more reagents are combined. 
They did have difficulty in dealing 
with comparisons based upon 
logarithmic functions and involving 
practical applications. They also had 
difficulty determining K b and other 
values that required the use of 
principles related to equilibrium. In 
general, they were able to apply their 
knowledge in new and novel situations 
and, as a result, were very successful 
in creating responses. However, they 
had some difficulty in relating 
concepts learned in the classroom to 



real-life applications. The linked 
questions did not provide them with 
any difficulties. As expected, they did 
well on all sections of the 
examination. 

Do the population and performance 
data reveal any significant trends? 

As expected, the previously identified 
trend of significant Grade 1 1 student 
participation continued this year, 
reaching the level that existed before 
the implementation of the revised 
curriculum. The number of Grade 1 1 
students in 1996-97 increased 
significantly, from 8.5% of the 
population in 1995-96 to 9.5%. The 
Grade 1 1 students’ achievement in 
Chemistry 30 continued to be strong, 
with these students attaining an 
examination average of 66.9%. This 
high success is partially due to the 
International Baccalaureate Chemistry 
program, where some students write 
the Chemistry 30 diploma 



examinations in the second year of the 
program (Grade 11). It is expected 
that the number of Grade 1 1 students 
enrolled in Chemistry 30 will remain 
around 10% in 1997-98. 

The achievement of out-of-province 
students rose slightly relative to that of 
Grade 12 students, while the 
achievement of atypical students did 
not change relative to the Grade 1 2 
students. 

Overall, there was no significant 
improvement or decline in any 
curricular area. However, student 
performance on concepts directly 
related to equilibrium is not as great as 
on other concepts of equal challenge. 
The same is also true of student 
performance in relating concepts 
learned in the classroom to real-life 
situations. These weaknesses may be 
due, in part, to the sophistication of 
the revised chemistry curriculum. 



Table 6-12 

Chemistry 30 Diploma Examination 

Five-Year Comparison by Population Percentage and Achievement Averages 



Year 


Subgroup 


Grade 1 1 
Students 


Grade 12 
Students 


Atypical 
Exam Writers* 


Transferred in 
From Outside 
the Province 


1996-97 


Percentage of Population 


9.5 


84.1 


2.5 


3.9 




Examination Average 


66.9 


62.3 


54.5 


63.0 


1995-96 


Percentage of Population 


8.5 


85.5 


2.2 


3.8 




Examination Average 


67.0 


63.9 


56.1 


62.9 


1994-95 


Percentage of Population 


6.3 


86.4 


3.0 


4.3 




Examination Average 


68.2 


65.5 


57.6 


66.3 


1993-94 


Percentage of Population 


3.5 


86.8 


4.7 


5.0 




Examination Average 


70.2 


63.4 


56.6 


65.9 


1992-93 


Percentage of Population 


8.0 


82.7 


4.4 


4.9 




Examination Average 


67.8 


64.3 


57.7 


66.1 



*This group includes repeaters, individuals challenging the examination, and students without a school-awarded mark. 
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Physics 30 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 8 391 students with 
corresponding school -awarded marks 
wrote the Physics 30 diploma 
examinations. The participation rate 
in Physics 30 consisted of 62.1 % male 
students (5 207) and 37.9% female 
students (3 184). Compared with 
1995-96, the participation rate for 
males and females has remained 
relatively constant. 

As shown in Figure 2-3, Physics 30 
students write, on average, 4.4 
different diploma examinations. Only 
students writing Fran 9 ais 30 write 
more. 

Physics 30 continues to be a course 
designed for students going on to 
academic and technological post- 
secondary physics- and science-related 
programs. Registration in Physics 30 
should continue to be encouraged, as 
many career opportunities require the 
knowledge and skills supported by the 
high school physics program. 



What is the overall performance of 
students on the examinations? 

The overall performance of students 
writing the Physics 30 diploma 
examinations during the 1996-97 
school year was satisfactory (see 
Figure 6-10). Although overall diploma 
results were consistent with the 
performance in previous years (Table 
6-13), 2.8% fewer students (22.9%) 
achieved the standard of excellence 
than in 1995-96. The proportion of 
students that failed to achieve the 
acceptable standard was 19.5%, 
compared with the previous year’s 
proportion of 20.3%. 

Acceptable Standard 

In 1996-97, students who achieved the 
acceptable standard but not the 
standard of excellence (57.6%) could 
reliably state and solve problems that 
could be related quickly to an equation 
in the data booklet. For this group, 
laboratory skills were limited to using 
laboratory data to verify known physics 
information. These students were 
capable of producing a graph from raw 
data, calculating quantities such as 



Figure 6-10 



Physics 30 

Distribution of Diploma Examination Marks 
1996-97 School Year 




Diploma Examination Mark % 




Students achieving the acceptable standard 
but not the standard of excellence. 



■ Students achieving the 
standard of excellence. 



momentum, energy, voltages, stopping 
voltages, centripetal force, and 
distances travelled by electromagnetic 
waves. They tended to use item- 
specific methods in their problem 
solving, and rarely used the major 
generalizations of physics, such as 
Newton’s laws or those of the 
conservation of energy or charge. In 
addition, these students had difficulty 
communicating. For example, they 
had trouble explaining their method of 
solving a problem. Thus, students 
performing near the acceptable 
standard showed only limited 
understanding of the full scope of the 
Physics 30 program of studies. Within 
this restricted range of content, such 
students performed well. 

In addition, students with final course 
marks near the acceptable standard 
used the data booklet supplied more as 
a crutch than as a summary of the 
physics content. Those who achieved 
this standard showed that they could 
use the equations and information 
provided to solve problems requiring 
single-step calculations and simple 
two-step calculations. They were also 
competent in recalling facts and 
essential definitions related to specific 
concepts. Many students found it 
difficult to translate definitions into 
alternative forms and to judge whether 
a data book value was valid within the 
range of values given in a particular 
problem. These students had difficulty 
identifying a relationship between two 
variables that had been expressed in a 
graphical representation. Students 
achieving at this standard found it 
difficult to make predictions based on 
information or data presented. They 
found the multiple-choice section far 
easier than the written-response 
section, and typically scored 30% 
higher on this section of the exam. 



Standard of Excellence 

Students achieving the standard of 
excellence (22.9%) showed far more 
flexibility and creativity than those 
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students achieving the acceptable 
standard but not the standard of 
excellence. They used general 
methods of solution and were not 
afraid to use conservation laws to 
solve unusual problems. They 
illustrated a transference of knowledge 
from one area of physics to another 
and expressed their answers clearly 
and concisely. They made inferences 
that were not part of their “known” 
area of physics. These students were 
able to use generalizations of physics 
and to distinguish between vectors and 
scalars or forces and fields. 

In 1996-97, students with final course 
marks near the standard of excellence 
tended to use the data booklet to 
support their problem-solving 
strategies, but were not overly 
dependent upon it. These students 
stated and easily recognized 
relationships between variables. They 
were able to derive equations as 
needed, design procedures for a 
laboratory activity, and communicate 
effectively the procedures used to 
arrive at a solution. Those who 
achieved just below this standard had 
some difficulty with questions that 
required multistep solutions, and they 



needed explicit cues before they were 
able to use a wider range of problem- 
solving strategies. In many cases, 
such students solved more complex 
problems in the multiple-choice 
format, but experienced difficulty with 
similar concepts tested in a written- 
response format. They were adept at 
selecting the correct response in the 
multiple-choice section and in creating 
their own responses for similar 
questions in the numerical-response 
sections. When confronted with a 
problem requiring the use of two or 
more steps, they created their own 
procedures for solving problems. 

Many of their responses to the written- 
response questions showed a high 
level of sophistication. 

Do the population and performance 
data reveal any significant trends? 

Based on the actual results of students 
writing the Physics 30 diploma 
examinations, achievement has been 
fairly consistent (Table 6-13). 

Students continue to do well on the 
multiple-choice section of the 
examinations and continue to improve 
on the numerical-response section. In 



the written-response section, there 
continues to be a decrease in the 
number of students who leave 
questions blank. 

Achievement has improved in some 
specific areas. Students have shown a 
marked increase in their ability to solve 
problems involving routine 
calculations. They perform well on 
problems requiring single-step or two- 
step calculations, but continue to have 
major difficulties using ratios. A 
second area of improvement is in the 
students’ ability to deal with questions 
involving scenarios or technology. 
Students are beginning to gain 
confidence in their ability to apply their 
knowledge of physics to real-life 
situations. This is especially evident in 
the open-ended written- response 
questions. More students are 
attempting these questions, and there 
has been a marked improvement in 
their ability to organize their answers 
and to clearly communicate their 
solutions. Students are still 
experiencing difficulty with the 
concepts of electric and magnetic fields 
and electromagnetic induction. 
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Table 6-13 
Physics 30 

Five-Year Comparison of Selected Population and Achievement Indicators 





1992-93 


1993-94 


1994-95 


1995-96 


1996-97 


Number of Students with a School- A warded Mark 


8 458 


7 488 


7 717 


8 068 


8 391 


Malc/Fcmale Proportions (%) 


64/36 


64/36 


63/37 


63/37 


62/38 


Students Achieving Acceptable Standard 
on Diploma Exam (%) 


81.5 


84.8 


83.7 


79.7 


80.5 


Students Achieving Standard of Excellence 
on Diploma Exam (%) 


26.6 


32.3 


28.2 


25.7 


22.9 
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Science 30 



What are the characteristics of the 
student population that wrote the 
examinations? 

In 1996-97, 1 077 students with 
corresponding school-awarded marks 
wrote the Science 30 diploma 
examinations. In 1995-96, 976 
students wrote the examination, and 
there were 1 378 students who 
received final marks in the 1994—95 
implementation year. No diploma 
examinations were written in the 
implementation year, so students 
received a school-awarded mark only. 
Such a low enrollment is 
disappointing because the Science 30 
course is designed to give a broad 
science education to students who are 
intending to pursue post- secondary 
studies, but not necessarily in a 
science discipline. Both NAIT and 
SAIT have recognized the value of 
promoting science literacy through an 
integrated science course by making 
Science 30 a recommended 
prerequisite for some of their courses. 
SAIT has expressed interest in using 
the Science 30 data booklet in some of 
its entrance examinations. It is hoped 
that this kind of support and the 
acceptance of Science 30 by colleges 
and universities will encourage an 
increasing enrollment in Science 30 in 
future years. 

The average number of different 
diploma examinations written by the 
Science 30 population in 1996-97 was 
3.7. This compares with the average 
of 3.8 different diploma examinations 
written by all students (see Figure 
2-3). Whereas most students who 
enroll in a science discipline (biology, 
chemistry, or physics) enroll in one or 
two additional science courses, only 
9.0% of Science 30 students enrolled 
in another science course. Enrolling 
in Science 30 and a discipline course 
would give students an advantage in 
both subjects and a rich science 
experience. Such a combination 
would also result in a greater number 
of options for post-secondary study. 

The Science 30 population comprises 
more males than females. About 
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52.1% of students writing Science 30 
diploma examinations were male; 
47.9% were female. 

What is the overall performance of 
students on the examination? 

In 1996-97, 81.3% of the students 
writing Science 30 attained the 
acceptable standard. A fair number 
of students (9.3%) attained marks 
ranging from 44% to 49%. When the 
exam mark was blended with the 
school mark, 90.2% of the students 
achieved the acceptable standard. 

The percentage of students who 
achieved the standard of excellence on 
the Science 30 diploma examinations 
was 10.0%. 

Of the 1 083 students who wrote the 
examination, 58 were mature students 
who also received a school mark. The 
average of this group was 63.5%. 

Four mature students challenged the 
examination and attained an average 
of 35.0%. The sixteen regular 
students who rewrote the examination 
achieved an average of 57.6%. 

The percentage of males who achieved 
the acceptable standard was 81.8% 
compared with 80.8% of female 
students. The percentage of males 
who achieved the standard of 
excellence was 9.8% compared with 
10.3% of female students. The 
average for males on the Science 30 
examinations was 62.5% compared 
with 61.4% for females. Although the 
male population seems to have a slight 
advantage on the examination, the 
reverse is true for the school-awarded 
mark, and the blended mark for males, 
compared with that for females, is 
almost identical. 

Standards for Science 30 are outlined 
in detail in the 1994—95 Science 30 
Information Bulletin , pages 39 to 64. 
The emphases on science literacy and 
communication skills in the 
Science 30 curriculum were 
incorporated into the examination. On 
the examination, students were 
expected to use a data booklet to solve 
physics-, chemistry-, and biology- 



based problems, design and interpret 
scientific studies, provide risk-benefit 
analyses for some technologies, and 
defend a point of view on an issue 
related to science and society. The 
Science 30 Bulletin outlines the scoring 
criteria for these questions. 

Acceptable Standard 

In 1996-97, students who achieved the 
acceptable standard but not the 
standard of excellence (71.3%) were 
able to locate the appropriate 
information in the data booklet and use 
the information to answer one-step 
problems. Questions involving Ohm’s 
Law, field strength, frequency, and 
wave length were answered correctly by 
these students, but they had difficulty if 
the questions were embedded in a 
context. For example, these students 
would be able to determine the 
resistance in an electrical circuit, given 
the amperage and voltage. They would 
have difficulty, however, if the circuit 
was presented in diagram format with 
the values of voltmeters and ammeters 
given. Many students in this group had 
difficulty solving titration problems. 
They knew the general characteristics 
of fission and fusion reactions, but had 
difficulty with mass-to-energy 
calculations. These students generally 
had a good understanding of the source 
of pollutants and the risks and benefits 
associated with various energy sources. 
When describing a technology and how 
it works, they tended to give general 
descriptions that lacked detail and 
specific examples. These students 
successfully interpreted simple graphs. 
They wrote appropriate problems and 
hypotheses for an experimental design, 
but their interpretation of scientific 
studies lacked depth. These students 
solved one-trait Mendelian crosses, but 
had difficulty solving problems that 
included x-linkage. 

Students who did not achieve the 
acceptable standard of performance on 
the Science 30 diploma examinations 
(18.7%) had difficulty finding the 
appropriate information in the data 
booklet and applying it to solve a 
problem. They were often unable to 
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differentiate between fission and 
fusion reactions. Some of the students 
in this group identified pollution 
sources and were able to give some 
risks and benefits associated with 
various energy sources. They 
summarized the data represented by a 
graph, but presented limited 
interpretations of graphs or scientific 
studies. When presenting a problem 
or hypothesis, they often lacked 
specificity or did not concentrate on 
the idea behind the study. These 
students recalled facts about the body 
systems, but had difficulty with 
genetic crosses and feedback 
mechanisms that regulate bodily 
functions. 

Standard of Excellence 

Students who achieved the standard of 
excellence on the Science 30 diploma 
examination (10.0%) had little 
difficulty solving problems, whether 
they were presented in a straight- 
forward statement or embedded in a 
context. The interpretation of 
electrical circuits presented little 
difficulty. Many of the students in 
this group solved titration problems 
and mass-to-energy conversions, 
balanced nuclear equations, and 
applied Hesse’s Law to combustion 



reactions. Genetics and the inter- 
relationships among the body systems 
were well understood. 

Students who achieved the standard of 
excellence were able to critically 
analyze scientific studies, including 
the associated charts, graphs, and 
conclusions. These students were 
aware of a variety of viewpoints 
relating to the environmental and 
ethical issues in the field of science 
and technology. They clearly 
expressed their opinions about these 
issues. 

Do the population and performance 
data reveal any significant trends? 

Although 1996-97 was only the 
second year that Science 30 students 
wrote a diploma examination, some 
trends are apparent from field test data 
and the 1995-96 examinations. 
Students in the previous year struggled 
with questions when they had to find 
information in the data book. Students 
who wrote the examinations in 1996- 
97 were very successful with this type 
of question. 

Students have shown a steady 
improvement in communication skills 
from the first field tests in 1994 to the 



written-response questions on the June 
1997 diploma examinations. The 
majority of students are now able to 
ascertain what the question is asking 
and can present a well-organized 
answer that contains specific examples 
to support their opinions. 

Students continue to experience 
difficulty in writing about major 
technologies from the STS component 
of the course. They also have 
difficulty with multistep problems, 
genetic-inheritance calculations, and 
the interpretation of electrical circuit 
diagrams. 

It is expected that responses to 
questions that require a student to 
design or interpret a scientific study 
will improve as students experience 
these types of questions in the 
classroom and on future diploma 
examinations. 

The number of students writing the 
Science 30 diploma examination 
increased from 1995-96 to 1996-97. 

It is hoped that a trend of increasing 
enrollment will continue, given the 
high regard that NAIT, SAIT, and 
other post-secondary institutions have 
shown for the program. 



Figure 6-11 



Science 30 

Distribution of Diploma Examination Marks 
1996-97 School Year 
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Students achieving the acceptable standard 
but not the standard of excellence. 



■ Students achieving the 
standard of excellence. 
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Appendix A 

Diploma Examination Development Process 



The staff of the Student Evaluation 
Branch give great care and attention to 
the development and marking of all 
diploma examinations to ensure that 
students’ marks on diploma 
examinations are fair and equitable 
measures of their achievement. 

Professional staff of the Student 
Evaluation Branch work with many 
individuals in the complex process of 
developing diploma examinations. 
Classroom teachers, school and 
jurisdiction administrators, 
representatives from post- secondary 
institutions, and staff of the 
Curriculum Standards Branch and 
Language Services Branch are all 
involved. 



It takes approximately 1 8 months to 
complete the development of a 
diploma examination. The 
examination development process 
follows these steps: 

• Planning 

• Approving Examination Blueprints 

• Developing Examination Questions 

• Constructing and Administering 
Field Tests 

• Analyzing and Revising Questions 



• Constructing the Examinations 

• Approving the Examinations 

• Printing and Administering the 
Examinations 

• Marking the Examinations 

• Analyzing and Reporting the Results 



Planning 

The first step in the planning phase is 
to prepare (under direction from the 
Curriculum Standards Branch) 
specifications based on the goals and 
objectives of the curriculum for each 
subject. 

Examination developers in each 
diploma examination course then 
prepare an interim examination 
blueprint. An examination blueprint is 
an overall plan used to guide the 
development of an examination. If a 
diploma examination is undergoing 
extensive revision because of 
curricular change, or if a new 
examination is to be developed, an 
advisory committee of teachers and 
subject consultants will contribute to 
decisions about the emphasis and 
design of the examination. 

As blueprints are drafted and 
examinations designed, examination 
developers and advisory committees 
must address these questions: 

• What knowledge and skills can 
students be expected to possess? 

• How can the various parts of the 
curriculum best be tested? 

O 




• What should be the weighting for 
each part of the curriculum tested? 

• How long and how demanding should 
the examination be? 

• What format will produce the most 
valid results? 

• What types of questions will be most 
valid and reliable? (Multiple choice, 
short answer, extended written 
response?) 

• How should the examination be 
organized to produce valid and 
reliable results? 

• How will students’ responses be 
scored? What will the criteria be for 
scoring? 

• How should the results be reported? 

• Who will receive the results? 

To ensure that each examination is a 
fair and equitable measure of students’ 
accomplishments in the course, and to 
ensure that results will be meaningful 
and reliable, examination developers 
incorporate curricular as well as 
statistical standards into the 
examination design. 



Examination questions are developed to 
reflect the range of expectations for 
students’ achievement that is embedded 
in the curriculum. Each question is 
classified and cross-referenced to the 
curriculum in terms of the specified 
knowledge, skills, and understanding 
that the question is designed to assess. 
The range of difficulty embedded in the 
curriculum dictates the range of 
difficulty of examination questions. 

Field testing confirms and validates the 
curricular expectations as reflected by 
the questions. Item analysis of the 
machine-scorable field-tested questions 
provides technical data about the 
relative difficulty of questions and 
about the technical strength of sets of 
questions. Field-tested questions are 
kept for use on a diploma examination 
or are re-field tested to ensure that they 
meet appropriate technical and 
curricular standards, or such questions 
are discarded. 

Approving Examination 

Blueprints 

When examination developers and their 
advisory committees have developed an 
examination design and blueprint, 
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including criteria for scoring written 
responses, a committee of Alberta 
Education staff (Regional Offices of 
Alberta Education, the Curriculum 
Standards Branch, Language Services 
Branch, and the Student Evaluation 
Branch) review the proposed design. 
The blueprint and design the committee 
recommends are then reviewed by an 
Examination Advisory Committee 
consisting of representatives nominated 
by the Alberta Teachers’ Association, 
the Conference of Alberta School 
Superintendents, the Universities 
Co-ordinating Council, the Public 
Colleges of Alberta, Alberta Education, 
and representatives from business, 
industry, and other professional 
organizations and non-government 
agencies. This committee makes 
recommendations regarding the final 
examination design to the Director of 
the Student Evaluation Branch. 

Developing 

Examination 

Questions 

Following approval of the examination 
design, format, and blueprints, 
examination developers plan for 
question development. On the 
recommendations of superintendents, 
classroom teachers from across the 
province are selected to work on 
question development committees 
chaired by examination developers from 
the Student Evaluation Branch. 

Professional examination development 
staff of the Student Evaluation Branch 
ensure that teachers serving on question 
development committees understand the 
technical principles of question 
construction. The teacher committees 
develop questions that meet the 
curricular and technical standards 
incorporated in the examination design 
and blueprints, and that will fairly test 
the skills and concepts that students can 
be expected to have acquired. 

Questions developed in committee are 
then carefully screened, edited, and 
revised so that all blueprint 
requirements and technical standards are 
met. At this point, copyright approval is 
sought for testing materials such as 
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literary selections, cartoons, graphs, 
maps, charts, and data sets. 

Constructing and 
Administering 

Field Tests 

Examination developers at the Student 
Evaluation Branch construct field tests 
containing questions developed by the 
teacher committees. Each field test is 
carefully edited and revised to ensure 
technical and curricular validity, and 
faithfulness to the examination blueprint. 
School jurisdiction personnel grant 
permission for the administration of 
field tests to students in their systems in 
January and/or June of each school year. 

Based on the geographic and 
demographic variables expected for the 
total population that will write a given 
diploma examination, the Student 
Evaluation Branch field-testing 
administration staff selects a minimum 
sample of 250 students to write each 
field test. Field tests are administered 
only to students who are nearing 
completion of the diploma examination 
subject being tested so that their 
performances on the field test will be 
predictive of the performances of 
students writing the diploma 
examination. 

Student Evaluation Branch professional 
staff members administer the field tests 
under secured examination conditions. 
This procedure allows examination 
developers to receive first-hand 
information from teachers and students 
about examination questions and 
formats. As well, the procedure ensures 
test security and uniform administration 
conditions so that statistical results can 
be considered reliable. 

Teachers whose classes participate in 
field testing comment on: 

• level of difficulty of questions 

• curricular validity 

• appropriateness of questions, data sets, 
reading selections, format 

• problems with questions, stimulus 
material, art work 

• clarity of instructions 

• correspondence between questions and 
the way in which a concept is taught 
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Students are also encouraged to 
discuss the field test with the field test 
administrator. 

All of the data from field testing — 
statistical and anecdotal — provide the 
examination developer with accurate 
and first-hand information that is used 
to ensure that the final form of each 
diploma examination is a valid and 
reliable measure of students’ 
achievement. 

Analyzing and 
Revising Questions 

Examination developers carefully 
analyze the statistical results and 
teacher comments for each field test to 
determine the need for additional field 
testing. Individual questions or 
question sets requiring changes are 
revised and submitted for further field 
testing. If changes are not feasible, 
questions are discarded. 

Questions and question sets that prove 
successful in field testing are 
considered for inclusion in a diploma 
examination. 

Constructing the 
Examinations 

The diploma examinations are 
composed of questions and/or 
question sets that have proven to be 
valid in field testing. For each 
diploma subject, parallel examinations 
are developed annually for 
administration in November, January, 
April, June, and August. The 
examinations are designed to be 
parallel in form and equivalent in 
difficulty. Each examination is 
constructed according to the approved 
blueprint (i.e., each will have 
approximately the same number of 
questions testing a particular facet of 
the curriculum as specified by the 
blueprint). An information bulletin 
outlining the design, format, and 
marking criteria for each diploma 
examination subject is distributed to 
schools at the beginning of each 
school year. The information bulletins 
include changes from previous years’ 
examinations and scoring guides. 
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Approving the 
Examinations 

Once a final form of a diploma 
examination is drafted, it receives 
editing, proofreading, and technical 
checking. The examination developers 
from the Student Evaluation Branch 
present the final form of each 
examination to an Alberta Education 
committee that gives the examination 
a thorough technical review. 

The recommendations of the Alberta 
Education committee are incorporated 
into any additional revisions that are 
necessary. 

The Examination Advisory Committee 
also meets each administration to 
review the results of the past year’s 
examinations and to advise on policy 
issues that affect the design, 
development, and administration of 
the examinations and the reporting and 
interpretation of the results. 

Printing and 
Administering the 
Examinations 

Following the Director’s approval of 
the final form of a diploma 
examination, examination developers 
ensure completion of additional 
quality checks that include editing, 
proofreading, validating of correct 
answers by a teacher committee, 
checking print quality of art work and 
illustrations, confirming precise match 
to the blueprint, and completing a final 
estimate of difficulty for each 
question. 

Each examination is printed and then 
distributed to schools just before the 
administration dates. 

Schools are responsible for ensuring 
the security of examinations before 
administration and for ensuring that 
examinations are administered 
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according to regulations. Each school 
receives extra copies of the January 
and June examinations for use in the 
school. 

Diploma examinations are scheduled 
annually in November, January, April, 
June, and August, and are conducted 
according to examination regulations. 
Schedules and regulations are 
published in the General Information 
Bulletin that is distributed to schools 
each fall. 

The November, April, and August 
examinations are secured. 

Students identified as having learning 
and/or physical disabilities may apply 
for special provisions for examination 
writing. Special provisions include 
braille examinations, large-print 
examinations, tape-recorded 
examinations, additional writing time, 
use of a word processor, use of a tape 
recorder for responses, and use of a 
sign-language translator. The 
complete policy for special provisions 
is printed in the General Information 
Bulletin and is available on request 
from the Student Evaluation Branch 
(telephone 403-427-0010). Following 
administration, completed 
examinations are shipped (in 
accordance with security regulations) 
to Alberta Education in Edmonton for 
processing and marking. 



Marking the 
Examinations 

Markers for the written-response parts 
of the examinations are teachers 
nominated by their superintendents 
and selected on a proportional basis so 
that the percentage of markers selected 
from a geographic area is comparable 
to the percentage of papers from that 
area. To be selected for marking, a 
teacher must be currently teaching the 
subject he or she wishes to mark, must 
have taught the course for at least two 
years, and must possess a valid 
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Alberta Permanent Professional 
teaching certificate. 

Selected classroom teachers are trained 
in the marking procedures and are 
supervised during the marking session 
by the professional staff from the 
Student Evaluation Branch. 

The written-response parts of the 
diploma examinations are all marked 
centrally. All student and school 
identification is removed from the 
papers before the marking so that 
markers have no means of knowing the 
source of a paper. Multiple-choice and 
numerical-response questions are 
computer- scored. 

Analyzing and 
Reporting the Results 

The statistical results of each 
examination are carefully analyzed. 

The Examination Advisory Committee 
may be asked to review the results as 
well. Reports of local results in each 
subject are prepared for all school 
jurisdictions. 

Individual student results are mailed 
about one month after the date on 
which the examinations were 
administered. Students who are 
dissatisfied with their results in any 
subject may request that their 
examination in that subject be rescored. 
The fee for rescoring, including GST, 
is $26.75 per examination. The mark 
awarded after the rescoring supersedes 
the initial mark. 

For more information, call the Assistant 
Director of Humanities Exams for 
Language Arts and Social Studies or 
the Assistant Director of Math/Sciences 
Exams at 403-427-0010. 
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the Results of the Diploma Examinations 










Purpose of the Reports 



The jurisdiction and school reports 
describe the results achieved by 
students who wrote diploma 
examinations in this administration 
and who had a school-awarded mark. 

If requested by the superintendent, 
similar reports for instructional groups 
in the school are also provided. The 
figures reported do not reflect the 
results of appeals of school-awarded 
marks, rereads of diploma 
examinations, or special cases 
considerations. 

Alberta Education, school authorities, 
and schools are responsible for 
ensuring that the highest possible 
quality of education is provided for 
students. The results from provincial 
assessments allow the government, 
provincial officials, school board 
members, superintendents, principals, 
teachers, school councils, parents and 
community members to examine 
results in relation to provincial goals 
and standards. 

Results from diploma examinations 
provide information which can help 
identify areas of strength, areas 
needing improvement, and the 
progress being made toward the 
achievement of goals. The careful 
interpretation of results from diploma 
examinations informs decisions about 
how to improve student learning. 

As noted in the Guide for School 
Board Planning and Reporting , 
reporting on the results achieved is one 
of the keys to establishing processes 
that lead to continuous improvements 
to education. 

Diploma examination results provide 
only part of the overall picture of the 
province’s, a school jurisdiction’s, or a 
school’s performance. Although 
provincial assessments are designed to 
assess the achievement of provincial 
standards as reflected in the Program 
of Studies, many important learning 
outcomes cannot be measured by time- 
limited, paper-and-pencil tests. In 
addition, many factors contribute to 
student achievement. The analysis, 
interpretation, use and communication 
of results from diploma examinations 
S^ieed to take these factors into account. 



The school and jurisdiction are in the 
best position to accurately interpret, 
use and communicate diploma 
examination results as they pertain to 
the school or jurisdiction. Wherever 
possible, information about a school’s 
or jurisdiction’s results should be 
obtained from the school or 
jurisdiction. 

Considerations 

1. Each school authority, in 
collaboration with its community, 
is expected to use the results from 
diploma examinations for its 
jurisdiction together with data 
from other performance measures 
to plan improvements in 
performance of the school 
jurisdiction. The school authority 
is expected to report annually to 
the parents and taxpayers in the 
jurisdiction the results for the 
jurisdiction on provincial 
assessments. (See Guide for 
School Board Planning and 
Reporting for complete 
requirements.) 

2. The school principal and teachers, 
in collaboration with parents and 
the community, are expected to 
use their school results on diploma 
examinations together with data 
from other performance measures 
to plan improvements in the 
performance of the students. They 
are expected to report the school’s 
results on provincial assessments 
annually to the parents of students 
in the school, the school council, 
and to taxpayers in the school’s 
community. In most cases, 
reporting results after each 
administration does not give an 
accurate picture of school or 
jurisdiction results. 

3. Results on provincial assessments 
for individual students and for 
groups of fewer than five students 
shall not be publicly released. 
Although parents, community 
members, and taxpayers have the 
right to know how well schools, 
school jurisdictions, and the 
province are performing, the right 
to privacy of the individual student 
must be ensured. When there are 




few students writing a diploma 
examination at one administration, 
consideration should be given to 
reporting annual results only. 

Annual results together with results 
for the last four years are provided 
by Alberta Education. 

4. Results from provincial assessments 
can assist teachers in their 
assessment of their own 
instructional practice and can assist 
others in the review of a teacher’ s 
instructional practice; however, 
results from provincial assessments 
shall not be used as the sole basis 
for evaluating teacher performance. 
The performance of students on 
provincial assessments is the result 
of several years in school and other 
variables and cannot be solely 
attributed to one teacher. 

5. School jurisdiction and school 
results on provincial assessments 
should be communicated together 
with provincial results and 
standards, all of the other measures 
which provide indications of a 
school’s or a jurisdiction’s 
performance, local targets, the 
contexts for learning, and plans for 
improvement. 

6. When comparisons are made against 
provincial standards and results, 
interpretations should take into 
account local targets, contexts and 
plans. 

7. Interpreting and communicating the 
results for small groups of students 
should be done in the awareness that 
the trends for small groups of 
students can be greatly influenced 
by the scores of one or two students. 
Instructional Group Reports for 
fewer than five students are not 
provided. 

8. The analysis, interpretation, use, and 
communication of results on 
diploma examinations should 
consider the limitations of 
provincial assessments and adhere 
to the Principles of Fair Student 
Assessment Practices for Education 
in Canada. 
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9. School -awarded marks and 
diploma examination marks are 
complementary measures. School- 
awarded marks should reflect all 
aspects of learning in a course, 
including those which cannot be 
measured by time-limited, paper- 
and-pencil tests. Although 
differences can be expected 
between a student’ s school- 
awarded mark and that student’s 
diploma examination mark in a 
course, large differences between 
school-awarded marks and 
diploma examination results for 
groups of students should be 
investigated. Final course mark 
distributions cannot be directly 
compared to school-awarded mark 
distributions or to diploma 
examination mark distributions, as 
the final mark is not independent 
of the other two marks. 

10. Factors affecting student selection 
of diploma examination courses 
vary from school to school. These 
factors should be considered when 
comparing school or juris idiction 
results with provincial results. 

The participation rates provided 
annually as part of the annual 
multiyear summary report should 
be used when interpreting or 
communicating the diploma 
examination results. 

1 1 . Some information about changes 
in student performance on diploma 
examinations from year to year 
can be derived by comparing the 
local percentage of students 
achieving standards to the 
provincial results in each of the 
years of interest. Direct 
comparison of percentages of 
students meeting standards or 
averages for a school or 
jurisdiction from year to year does 
not provide reliable information on 
changes in student performance. 
Changes in curriculum and 
standards over time affect the 
results. The diploma examinations 
are designed to be parallel in a 
given year but not necessarily 
across years. 

School Factors That Affect 
Student Achievement 

Research in education has identified 
key aspects of school effectiveness 
which affect student achievement. 

1. Productive School Climate and 
Culture 

O • There is a shared and articulated 




focus on achievement. 

• There is a shared belief that all 
students can achieve. 

• Staff is cohesive, collaborates, 
and makes decisions by 
consensus. 

2. Focus on Student Acquisition 

of Central Learning Skills 

• Teachers know what students 
are to learn and emphasize 
mastery of key concepts. 

• Students know what is expected 
of them. 

• Learning time is maximized. 

3. Appropriate Monitoring of 

Student Progress 

• Student progress is monitored, 
reported, and used for planning 
improvements. 

• Students can show what they 
have learned. 

• Parents know what their child 
has achieved. 

4. Outstanding Leadership 

• Effective instructional 
leadership is provided. 

5. Parent Involvement 

, • High levels of school and home 
cooperation are evident. 

6. Effective Instruction 

• Grouping and organizational 
arrangements are appropriate. 

• Pacing is appropriate. 

• Curriculum and learning are 
aligned. 

• Teachers use a variety of 
strategies. 

• Students are actively involved. 

7. High Expectations and 

Requirements for Students 

• Students are held responsible for 
learning. 

• Higher-order learning is 
emphasized. 

Many other factors can be considered 
in interpreting results and planning for 
improved learning. These include 
students’ abilities, attitudes, 
motivations, aspirations, academic 
backgrounds, and learning styles. 

They also include students’ family 
circumstances, socioeconomic 
backgrounds and community 
environments. 

A Systematic Approach for the 
Effective Use of Diploma 
Examination Results 

The interpretation and analysis of 
diploma examinations should be a 
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collaborative effort which can involve 
teachers, students, parents and the 
community. A systematic use of 
diploma examination results might 
include the following steps: 

1. Comparing test results for a school 
or instructional group with the 
provincial results. Be sure that 
your comparisons include the: 

• total test score 

• total on machine-scored and 
written-response questions 

• subscale scores for machine- 
scored and written-response 
questions 

• individual machine- scored and 
written-response question results 

• differences between school- 
awarded and diploma 
examination marks 

• participation rates in each course. 

2. Noting any patterns, anomalies 
and/or interrelationships in the 
results. 

3. Hypothesizing relationships 
between your observations and the 
factors that have an effect on 
achievement. 

4. Developing and implementing a 
plan to improve the quality of 
education for students. 

5. Developing and implementing a 
communication plan to share 
results and what the school is 
planning to do to improve student 
learning. 
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Percentage Distribution of Marks in Diploma Examination Courses 




January 1997* 




examinations, or special cases considerations. 

f The January 1997 results for Frangais 30 are not reported because only 22 students received final course 
marks. ' 
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January 1997* 




Diploma 


School- 


Diploma 


Final 


January 1996 


Examination 


Awarded 


Examination 


Final 


Course 


Mark 


Mark 


Course Mark 


Course Mark 


MATHEMATICS 30 






AT* = 9 470 


N = 9 614 


A (80-100%) 


26.1 


18.5 




20.7 


B (65-79%) 


35.6 


28.9 




31.2 


C (50-64%) 


30.1 


28.8 


33.9 


34.9 


F (0-49%) 


8.2 


23.8 


11.8 


13.2 






L 

1 

1 

1 

1 

1 

U 




Mean 


68.8 


62.5 


66.0 


65.4 


Standard Deviation 


14.2 


17.4 


ft* 14.9 


15.3 


MATHEMATICS 33 








TV = 4 786 


A (80-100%) 


13.0 


17.0 




13.6 


B (65-79%) 


32.4 


32.5 


35.6 


35.3 


C (50-64%) 


39.1 


31.7 


38.1 


38.4 


F (0-49%) 


15.5 


18.8 


m : ; 1 ft 1 i 


12.7 


Mean 


62.4 


63.6 




63.8 


Standard Deviation 


13.9 


15.6 


13.8 


13.7 


BIOLOGY 30 \ 






7 Mflfl 


N= 7 670 


A (80-100%) 


23.4 


23.0 




18.9 


B (65-79%) 


39.4 


28.4 


E 34.7-" sail 


34.6 


C (50-64%) 


31.0 


29.5 




36.9 


F (0-49%) 


6.2 


19.1 




9.6 


Mean 


68.6 


65.3 


Nji | m 

67.3 


66.0 


Standard Deviation 


12.9 


16.7 


14.0 


13.8 


CHEMISTRY 30 






msmm 


N= 7 209 




* The figures may change slightly as a result of appeals of school- awarded marks , rereads of diploma 
examinations , or special cases considerations . 
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Diploma Examination Courses 
Final Course Marks 
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Diploma Examination Courses 
Final Course Marks 
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^The January 1997 results for F rang a is 30 are not reported because only 22 students received final course marks. 



Percentage Distribution of Marks in Diploma Examination Courses 



June 1997 



Diploma 


School- 


Diploma 




June 1996 


Examination 


Awarded 


Examination 


Final 


Final 


Course 


Mark 


Mark 


Course Mark 


Course Mark 


ENGLISH 30 


N*- 12 163 


N=12 675 


A (80-100%) 


21.7 


14.3 


15.1 


16.8 


B (65-79%) 


42.7 


34.9 


41.3 


44.0 


C (50-64%) 


29.9 


37.2 


39.1 


35.4 


F (0-49%) 


5.7 


13.6 


: 4.5 


3.8 












Mean 


68.5 


64.4 


66.8 


67.8 ~ 


Standard Deviation 


12.6 


13.5 


11.7 


11.5 








w'K>\ s r 




ENGLISH 33 


N = 6 796 


N = 6 290 


A (80-100%) 


6.2 


6.7 


4.1 


4.6 


B (65-79%) 


34.4 


37.3 




37.7 


C (50-64%) 


45.3 


40.4 


503 


49.1 


F (0-49%) 


14.1 


15.6 


8.5 


8.6 


— — , — __ __ __ 











Mean 


60.8 


62.1 


62.0 


~ ”627 


Standard Deviation 


12.2 


12.0 


101 

1UJ 


10.5 








v ''Jy s * 'I 4 '# 1 




FRAN£AIS 30 




V = 44 


A (80-100%) 


17.2 


15.6 


15.6 


4.5 


B (65-79%) 


49.9 


39.1 


43.8 


56.9 


C (50-64%) 


26.6 


40.6 


373 


38.6 


F (0-49%) 


6.3 


4.7 


3.1 


0.0 


— — — — — — — — — - 


— — — . — 


— — — — . 


_ ■" : : : 





Mean 


68.7 


66.8 


68.0 


67.3 


Standard Deviation 


11.1 


11.6 


10.5 


8.3 












SOCIAL STUDIES 30 


N = 10 508 


V = 10 703 


A (80-100%) 


23.4 


15.4 


17.4 


19.3 


B (65-79%) 


41.1 


31.4 


37.0 

■ • 39.2 : 


37.4 


C (50-64%) 


31.5 


33.6 


36.4 


F (0-49%) 


4.0 


19.6 


h " V ■ '' 


6.9 


— 


— 





^ ' % 




Mean 


69.1 


63.1 


66.4 _ 


67.1 ”* 


Standard Deviation 


12.3 


14.9 


nit 

1^.0 


13.0 








i‘ >#x ?r'-8 




SOCIAL STUDIES 33 


V = 7 357 


N = 6 929 


A (80-100%) 


5.4 


7.2 


4.1 v- 

34.6 


4.3 


B (65-79%) 


31.7 


36.0 


37.0 


C (50-64%) 
F (0-49%) 


48.4 

14.5 


37.2 

19.6 


40.5 

4^ -11 


48.3 

10.4 


— — — — — — — — - 


— — 


— — — — — — — — . 


— . — . — - 


— 


Mean 


60.3 


61.1 


61.1i "V*'l 


61.7 


Standard Deviation 


11.7 


13.4 




10.9 



*N — the number of Alberta students who have both a school-awarded mark and a current diploma examination mark. 
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June 1997 



Diploma 


School- 


Diploma 


- - < ? 


June 1996 


Examination 


Awarded 


Examination 




Final 


Course 


Mark 


Mark 


Course Mark 


Course Mark 


MATHEMATICS 30 


||| 8 719 


N = 9 342 


A (80-100%) 


23.5 


17.1 


18.3 


18.2 


B (65-79%) 


33.8 


22.1 


28.0 


28.5 


C : (50-64%) 


33.4 


28.2 


37.1 


37.1 


F (0-49%) 


9.3 


32.6 


16.6 


16.2 


Mean 


67.3 


59.2 


63.5 


63.6 


Standard Deviation 


14.5 


19.0 


15.9 


15.9 


MATHEMATICS 33 


N = 5 645 I 


N = 5 530 


A (80-100%) 


13.1 


17.8 


13.6 


13.0 


B (65-79%) 


30.3 


29.6 


32.5 


31.8 


C (50-64%) 


38.8 


31.7 


38.9 


37.4 


F (0-49%) 


17.8 


20.9 




17.8 


Mean 


61.8 


63.0 


62.iT B 


~ 62X) ~ ~ “ 


Standard Deviation 


14.6 


16.3 


14 J 


14.7 


















? *• % i j : > V\ so • *& 




BIOLOGY 30 


N = 9 022 


N = 9 585 


A (80-100%) 


27.6 


25.1 


MMi ■ ^ 


20.9 


B (65-79%) 


36.7 


29.1 


33.4 


32.3 


C (50-64%) 


28.6 


27.0 


Ml ■ j|J| 


35.1 


F (0-49%) 


7.1 


18.8 


9 A 


11.7 


Mean 


69.4 


66.0 


68.0 


65.9 


Standard Deviation 


13.8 


17.2 


14.7 

IMmI |g| j||| 


14.7 


CHEMISTRY 30 


N = 8 141 


N = 8 225 


A (80-100%) 


27.0 


18.3 


20.5 


20.4 


B (65-79%) 


36.6 


28.9 


34 8 


36.5 


C (50-64%) 


28.4 


31.0 


34J 


32.6 


F (0-49%) 


8.0 


21.8 


10.4 ’’BCIC 


10.5 


Mean 


69.0 


63.1 


66.4 


66.6 


Standard Deviation 


14.2 


16.7 


Viki "< , 


14.4 


PHYSICS 30 


N = 5 128 


iV = 4 884 


A (80-100%) 


34.0 


19.0 


. 23.0 ! f /; 


111 


B (65-79%) 


37.7 


26.6 


36.2 


35.7 


C (50-64%) 


23.2 


31.7 


31.9 


27.3 


F (0-49%) 


5.1 


22.7 


so ' ■ - 

, : : : : * 1 ; : 


9.3 


Mean 

Standard Deviation 


~2A 

13.6 


_ 6 VL1 
17.0 


~ ”67.“ 


600 

15.2 












SCIENCE 30 


iV = 720 


N = 625 


A (80-100%) 
B (65-79%) 


6.8 

34.2 


8.1 

31.5 


' P- 

IS 0 
35.0 


6.4 

30.1 


C (50-64%) 


46.5 


40.0 


48.0 


51.0 


F (0-49%) 


12.5 


20.4 


| ria. 


12.5 


Mean 




_ 608 _ ~ — ~ 


:■ •: 61.6 


608 “ 


Standard Deviation 


11.6 


13.6 


11.2 • ' • 


11.8 



*N = the number of Alberta students who have both a school-awarded mark and a current diploma examination mark. 
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Diploma Examination Courses 
Final Course Marks 

June 1997 and June 1996 



Percentage of Students Achieving Acceptable Standard 
(Final Course Marks of 50% to 100%) 




Percentage of Students Achieving Standard of Excellence 
(Final Course Marks of 80% to 100%) 
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